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of education. ICCS 2016 was intended as an exploration of enduring and emerging challenges of 

educating young people in a world where contexts of democracy and civic participation continue 
to change. 

(CCS addressed research questions concerned with the following: 

(1) Students' knowledge and understanding of civics and citizenship and the factors associated 
with variations in this civic knowledge. 

(2) Students' current and expected future involvement in civic-related activities, their perceptions 
of their capacity to engage in these activities, and their perceptions of the value of civic 
engagement. 

(3) Students’ beliefs about contemporary civil and civic issues in society, including those concerned 
with civic institutions, rules, and social principles (democracy, citizenship, and diversity), as 
well as their perceptions of their communities and threats to the world's future. 

(4) The ways in which countries organize civic and citizenship education, with a particular focus 


on general approaches, the curriculum an 
future citizens' civic engagem 


In each of these domains, ICCS 20 
associated with those variations, a 


(CCS gather 


schools from 24 countries. Most o 
data were augmented by data from more than 37,000 teachers i 
data collected from school principals and national research cen 


d its delivery, and 


ent and inte 


16 investigated variations within and across coun 


nd changes since ICCS 2009. 


ed data from more than 94,000 students in their eigh 


f these countries had partici 


t 
pated in ICCS 2009. 
nthose schools and b 
ters. 


Key findings 


Provision of 


civic and citizenship education 


the processes used 
raction within and across communitie 


h year of schooling in 


to facilitate 
S. 


tries, factors 


about 3800 
The student 
y contextual 


Although different approaches to delivering civic and citizenship education were evident in the ICCS 
countries, the countries generally held most of the learning objectives for this area of education 
in common. In ICCS 2016, the aims that school principals considered to be the most important 
with respect to civic and citizenship education related to civic and political knowledge and skills: 
promoting students’ critical and independent thinking (64%), promoting students’ knowledge of 
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citizens' rights and responsibilities (6196), and developing students' skills and competencies i 
conflict resolution (44%). The three aims that teachers deemed the most important were promoting 
students' independent and critical thinking (6196), promoting knowledge of citizens' rights and 
responsibilities (5796), and promoting respect for an 
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According to the ICCS 2016 data, 11 of the participating countries 
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Civic knowledge 


The ICCS 2016 civic knowledge outcome measure was based on a 


test of 87 items which included 


42 items that were used in ICCS 2009. The majority of the items were presented as units in which 
some brief contextual stimulus (e.g., an image or some text) was followed by items relating to the 
context established by the stimulus. Seventy-eight items were multiple-choice and nine items 
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e Students working at Level C engage with the fundamental principles and broad concepts that 


underpin civics and citizenship. 


e Students working at Level B typically demonstrate some specific knowledge and understanding 


of the most pervasive civic and citizenship institutions, systems, and concepts. 


e Students working at Level A demonstrate a holistic knowledge and understanding of civic and 
citizenship concepts and demonstrate some critical perspective. 


On average across participating countries, three percent of students were below Proficiency 
Level D, 10 percent of students were classified as being at Proficiency Level D, 21 percent were 
at Proficiency Level C, 32 percent at Proficiency Level B, and 35 percent at proficiency Level A. 
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Civic knowledge varied more within than across countries. The median range between the lowest 


five percent and the highest 95 percent of stude 
spanned more than three levels on the ICCS civic knowledge scale. In contrast, the range of 
average civic knowledge scores across countries s 
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2016, the proportion of students at Level B and above (equivalent to Level 2 and above in the ICCS 
2009 nomenclature) on the civic knowledge scale increased from 61 percent to 67 percent. In 11 
of these 18 countries, the increase in average student civic knowledge was statistically significant. 


Civic knowledge was associated with student gender and background. Female students 
demonstrated higher civic knowledge than male students. The average civic knowledge score of 
female students was statistically significantly higher than that of male students in 19 countries. 
difference in average civic knowledge scale scores between female and 
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Television news and discussions with parents remained important sources of information for 
students engaging with political and social issues. Although students' use of newspapers declined 
over the seven years between 2009 and 2016, students were talking more frequently than in 
the previous survey with their parents about what was happening in other countries. Students' 
use of new social media for civic engagement remained limited and varied considerably across 


participating countries. 


Students' engagement in discussions about political and social issues and their confidence to 
participate in civic activities were somewhat stronger than they were in 2009. Students who 
reported high levels of interest in political and social issues were also those who were more likely 
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the results suggest increases since 2009 in students’ participation in voluntary activities and their 
expectations of engaging in elections. 
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Although the data analyses showed no associations between participation in legal protest activities 
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School contexts for civic and citizenship education 


The ICCS 2016 students and teachers were active participants in school life. In most of the ICCS 
2016 countries, students said they participated in classroom and school elections. However, the 
opportunities students had to actively participate in decisions about their respective schools 
differed across countries. Teachers were actively involved in decision-making processes. 
Although parents were involved in discussion about students' learning achievement, their broader 
involvement in decision-making processes was not substantial. 


Students in the participating countries were positive about classroom climates that they saw as 
receptive (open) to discussions. Students' interest in social and political issues, the level of education 
they expected to attain, and their civic knowledge were all positively associated with this perception. 
According to the ICCS data, verbal bullying had occurred in most of the participating countries, but 
principals and teachers had adopted initiatives to counter this and other forms of bullying at school. 


Schools were interacting with local communities when developing civic-related activities, and 
had also developed activities related to environmental sustainability. Most of the schools across 
participating countries had developed at least some initiatives concerned with environmenta 
sustainability, such as differential waste collection, recycling and waste reduction, and energy 
saving. According to surveyed teachers, the target-grade students were participating in activities 
pertaining to the environment mainly inside their schools. 


Countries differed in relation to civic learning processes and activities at school and in relation to 
teachers' preparedness for teaching civic-related topics. Students' reports regarding their civic 
learning at school were positively associated with students' interest in social and political issues, 
the level of education they expected to attain, and their civic knowledge. Civic and citizenship 
teaching and learning activities in classrooms varied considerably across countries. 


Explaining variation in students' civic knowledge and expected engagement 


The ICCS 2016 results provide insight into factors associated with civic knowledge. Analyses 
of multilevel models showed large variations across countries in the extent of variation and 
how much of that variation could be explained by factors within and between schools. Student- 
related characteristics and social background emerged as important predictors of students 
civic knowledge, while factors reflecting processes of civic learning showed relatively consistent 
associations with civic knowledge at the level of individual students, but less consistency at the 
school level. However, after we controlled for student characteristics and social background, some 
apparent associations between civic learning factors and civic knowledge were no longer significant. 


(CCS 2016 data analyses illustrated factors associated with expected student civic engagement. 
Multiple regression models using student background, experience with civic engagement, 
disposition toward engagement, and beliefs about citizenship and institutions explained between 
aquarter and a third of the variation in expected civic participation. Parental and student interest 
were the strongest student-background predictors of expected civic engagement. Female 
students were less inclined than male students to anticipate active political involvement in the 
future. Students' experience with civic engagement in the community or at school tended to be 
positively associated with their expected civic engagement as adults. Students' civic knowledge 
and self-efficacy as well as students' beliefs were consistent predictors of expected electoral and 
active political participation. 


Although more knowledgeable students were more likely than their less knowledgeable peers to 
expect participation in elections, they were less likely to anticipate active political involvement. 
Students who believed in the importance of civic engagement through established channels were 
also more likely to expect future civic participation. In most countries, trust in civic institutions was 
positively associated with students' expectations of electoral and active political participation. 
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Implications of findings 


The finding that civic knowledge improved in about half of the countries that participated in both 
ICCS 2009 and 2016 was not confined to countries with already high average levels of civic 
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This report not only highlights the relevance of civic and citizenship education in modern 
democracies but also emphasizes the importance of a comparative study of this learning area 
across a wide range of different societies. Given the ongoing challenges of preparing young people 
for citizenship in a changing world, we expect continued interest and an increased engagement in 
this unique study conducted across a wide range of regions, cultures, and societies. 


The original version of the book was revised. A correction to this book is available at https://doi.org/ 
10.1007/978-3-319-73963-2 9 
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Global developments since ICCS 2009 


The conception and development of ICCS 2016 has maintained continuity with and extended 


the 


scope of ICCS 2009 by measuring changes in civic and citizenship education contexts, processes, 
and outcomes, as well as outcomes between 2009 and 2016. Because changing national, regional, 


and global contexts also affect civic and citizenship education, ICCS is designed to respond 


such changes. 
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Research questions 

The key research questions for ICCS 2016 concern students' civic knowledge, dispositions to 
engage in society, and attitudes toward civic and citizenship issues. The questions also focus on 
the contexts for this learning area. 


The research questions played a central role in shaping the design of ICCS 2016 and its 
instrumentation. They also guided the development of the assessment framework and provided 
a structure for this first international report on ICCS 2016. 


+ 


Some of the key research questions are similar to those that were formulated for ICCS 2009. 
Each general research question (RQ) relates to asub-set of specific research questions addressed 
during ICCS 2016. Findings resulting from analyses of the data collected in relation to each of 
these questions are presented in this report. 


RQ 1 How is civic and citizenship education implemented in participating countries? 

This question focuses on the national contexts for civic and citizenship education. Results relating 
to it are reported primarily in Chapter 2. Data were collected via the national contexts survey, the 
school and teacher questionnaires, and reference to published sources. Analysis of these data 
sought answers to the following specific research questions: 


(a) What are the aims and principles of civic and citizenship education in each participating country? 
The analyses presented in this report focus (at the country level) on information from the 
national contexts survey about the background to and intentions behind civic and citizenship 
curricula in participating countries. 


(b) Which curricular approaches do participating countries choose to provide civic and citizenship 
education? 


=) 


Analyses center on different types of civic and citizenship education implemented i 
participating countries. 


(c) What changes and/or developments in this learning area can be observed since 2009? 
Analyses concern only those data collected from countries participating in both ICCS 2009 
and ICCS 2016. The focus is on reforms and changes in the national contexts for civic and 
citizenship education. 


RQ 2 What is the extent and variation of students' civic knowledge within and across 
participating countries? 

The results relating to this research question, which concerns student performance on the 
cognitive test, are reported primarily in Chapter 3. In order to provide answers to the following 
specific research questions, the analyses drew on student test data supplemented by student 
questionnaire data. 


(a) Are there variations in civic knowledge associated with student characteristics and background 
variables? 
The analyses presented in this report investigate the relationship between students' civic 
knowledge and background factors such as gender, family characteristics, and socioeconomic 
status. 


(b) What contextual factors explain variation in students' civic knowledge? 
Analyses reviewthe individual and combined influences of contextual variables such as home 
background, or school characteristics on variation in students' civic knowledge. 


(c) What changes in civic knowledge have occurred since 2009? 
Analyses are limited to the countries that participated in both cycles of ICCS and where the 
measures of civic knowledge were comparable across the cycles. 
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RQ 3 What is the extent of students’ engagement in different spheres of society, and which 
factors within or across countries are related to it? 


This research question, discussed in Chapter 4, focuses on students' current and expected future 
participation in civic and citizenship activities. Student questionnaire data were analyzed in order 
to answer the following specific research questions: 


(a) What is the extent and variation of students' civic participation in and out of school? 
The analyses in this report focus on students' reports of their past and current involvement 
in civic-related activities. 

(b) What beliefs do students hold regarding their own capacity to engage and the value of civic 
participation? 
Analyses consider students' perceptions of civic engagement. 


(c) What expectations do students have regarding civic and political participation in the near future or 
as adults? 


Analyses center on students' stated intentions to participate in different forms of civic or 
political activities. 


(d) What changes in student engagement can be observed since 2009? 
Analyses are limited to the countries that participated in both cycles of ICCS and where the 
measures of student engagement were comparable across the cycles. 


RQ4 What beliefs do students in participating countries hold regarding important civic issues 
in modern society and what are the factors influencing their variation? 

This research question, discussed primarily in Chapter 5, relates to measures of student beliefs. 
Student questionnaire data were analyzed in order to answer the following specific research 
questions: 


(a) What attitudes do students hold toward civic institutions and society? 
The analyses in this report investigate the ways in which students perceive society in general, 
along with its rules and institutions. 


(b) Whatare students' beliefs regarding the importance of different principles underlying society? 
Analyses focus on students' beliefs about democracy, citizenship, and diversity. 


(c) Whatare students' perceptions of their communities and societies? 
Analyses concern students' perceptions of global threats to the world's future. 


(d) What changes in student beliefs, attitudes, and values can be observed since 2009? 


Analyses are limited to those countries participating in both cycles of ICCS and where the 
measures of students' attitudes were comparable across the cycles. 


RQ 5 How are schools in the participating countries organized with regard to civic and 
citizenship education, and what is its association with students' learning outcomes? 

This research question concerns the ways that schools and their communities provide for civic 
and citizenship education. Results relating to this question are reported primarily in Chapter 6. 
Relevant data were collected via the school, teacher, and student questionnaires, and the student 
test of civic knowledge. Analyses of these data sought answers to the following specific research 
questions: 


(a) What are the general approaches to civic and citizenship education, curriculum, and/or program 
content structure and delivery? 
The analyses in this report provide reviews of school-level policies and school-level resourcing 
as well as schools’ structural approaches to managing the delivery of civic and citizenship 
education. 
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To what extent do schools in participating countries have processes in place that facilitate civic 
engagement? 

Analyses focus on whether and how school-based opportunities, school climate, and classroom 
climate promote civic engagement among students. 


To what extent do schools interact with their communities to foster students' civic engagement and 
learning? 

Analyses concern interactions between schools and their local communities. Analyses also 
cover the opportunities that schools provide to encourage students’ active civic involvement 
in their communities. 


How do schools and teachers perceive the role of civic and citizenship education across participating 
countries? 


Analyses address teachers' and principals' perceptions of the role that schools and teachers 
play in preparing young people for citizenship. The analyses also consider how these 
perceptions are reflected in school policies. In addition, comparable measures of perceptions 
and policy ambitions are used to measure changes in some constructs since ICCS 2009 for 
those countries that participated in both ICCS cycles. 


rticipating countries, populations, and sample design 

his report, the term "country" refers to both the countries and the sub-national entities within 
ntries that participated in the study; twenty-four countries participated in ICCS 2016 (Figure 
. Sixteen of those countries were from Europe, five from Latin America, and three from Asia. 
wo of the participating countries, only sub-national entities participated. In Belgium, ICCS 


16 was implemented only in the Flemish education system. In Germany, one state (Land), North 


ne-Westphalia, took part in ICCS 2016 as a benchmarking participant. As is the case with other 


EA studies, participation in ICCS is open to all IEA member countries and affiliates. Each country 


ides whether or not it will participate in an IEA study. 


ThelCCS 2016 student and teacher population definitions and sampling methods were the same 


ast 


hose used in ICCS 2009. The ICCS student population is defined as all students in Grade 8 


(students approximately 14 years of age), provided that the average age of students in this grade 
was 13.5 years or above at the time of the assessment. If the average age of students in Grade 8 
was below 13.5 years, Grade 9 became the target population.” 


The population for the ICCS teacher survey was defined as all teachers teaching regular school 


subj 


ects to students enrolled in the country's target grade at each sampled school. The teacher 


population included only those teachers who were teaching the target grade during the testing 


peri 


od and who had been employed at school since the beginning of the school year. 


The samples were designed as stratified two-stage cluster samples. During the first stage of 
sampling, PPS procedures (probability proportional to size as measured by the number of students 


enr 
req 
cha 


olled in a school) were used to sample schools within the participating countries. The numbers 
uired inthe samples to achieve the necessary precision were estimated on the basis of national 
racteristics. However, as a guide, the sampling team asked each country to plan for a minimum 


sample size of 150 schools.? 


2 Malta assessed Grade 9 students because the average age of Grade 8 students in that country is below 13.5. In order 
to assess a similar age group as in other Nordic countries, Norway deviated from the International Defined Target 
Population for ICCS 2016 and assessed Grade 9 instead of Grade 8. As a consequence, all Norwegian results in this 
report are presented with an annotation. Norway's inclusion of Grade 9 as an additional population in ICCS 2009 made 


it 
3 In 


possible to compare the 2009 and 2016 results for Norway for the chosen target population. 
Malta, where there were fewer than 150 schools, the survey was conducted in all schools. 
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The management of each sampled participating school provided a list of the target-grade classes.^ 
An intact class was then randomly selected from that list and all students in that class were surveyed. 
The number of students sampled in the countries that sampled 150 schools ranged from 3000 to 
4500. Appendix A documents the achieved samples for each country. 


ICCS aimed to sample up to 15 teachers at random from all teachers teaching the target grade at 
each sampled school. Because civic and citizenship education is widely acknowledged as a cross- 
curricular responsibility in ICCS countries (even in countries where civic and citizenship education 
is taught as a standalone subject) and because of the decision not to link teacher information to 
individual students, teachers from civic-related as well as non-civic-related subjects were surveyed. 
In schools with 21 or more teachers of the target grade, 15 teachers were sampled at random. In 
schools with 20 or fewer such teachers, all teachers were invited to participate. 


The participation rates required for students in each country were 85 percent of the selected 
schools and 85 percent of the selected students within the participating schools, or a weighted 
overall participation rate of 75 percent. The same criteria were applied to the teacher sample. The 
student and the teacher samples, however, were adjudicated independently. The tables in this 
report use annotations to identify those countries that met these response rates only after the 
inclusion of replacement schools; countries that did not meet the required response rates, even 
after replacement, are reported separately below the main section of each table.’ 


The ICCS 2016 assessment framework 


The ICCS 2016 assessment framework provided the conceptual underpinning for ICCS 2016 
(Schulz et al., 2016). The 2016 framework was developed as an extension and refinement of the 
(CCS 2009 framework (Schulz et al., 2008). This approach not only supported the measurement 
and ongoing reporting of core elements of ICCS (as measured and reported in ICCS 2009) but 
also allowed consideration of the newer global developments likely to have influenced civic and 
citizenship education since ICCS 2009. 


The structure of the ICCS 2016 framework and the suggested analytical implications of this 
structure are consistent with the corresponding features of the ICCS 2009 framework. The 2016 
framework differs from the 2009 framework only in terms of the addition of new content areas 
and some revisions to content within the framework. 


The 2016 framework consists of two parts: 


e The civics and citizenship framework: This outlines the outcome measures addressed by the 
cognitive test and the student perceptions questionnaire; 


e Thecontextual framework: This maps the contextual factors expected to influence outcomes and 
explain their variation. 


The civics and citizenship framework is organized around three dimensions as shown in Table 1.1. 


e Acontent dimension specifying the subject matter to be assessed within civics and citizenship 
(with regard to both affective-behavioral and cognitive aspects); 


e A cognitive dimension describing the thinking processes to be assessed in the student test; 
e An affective-behavioral dimension describing the types of student perceptions and activities 


measured by the student questionnaire. 


4 Anexhaustive and mutually exclusive partition of all the students in the tested grade. 

5 North Rhine-Westphalia (Germany) failed to meet the IEA sample participation requirements for the student survey. Because 
of North Rhine-Westphalia's very low response rates, this report presents only the overall results and thus no data by sub- 
groups for North Rhine-Westphalia. Likewise, the very low response rates (below 3096) for teachers in Estonia and Denmark 
mean that the only results presented for these countries are the overall results. Concerns about the extremely low response 
rates (less than 1096) for the teacher surveys in North Rhine-Westphalia (Germany) led to a decision not to include the 
corresponding data in this report. Because the teacher survey in Hong Kong (SAR of China) did not follow international 
sampling procedures, data from this participant were also excluded from reporting. 
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The four content domains in the ICCS assessment framework are civic society and systems, civic 


principles, civ 


ic participation, and civic identities (Table 1.1). Each of these contains a set of sub- 


domains that incorporate elements referred to as “aspects” and "key concepts.’ 


The two cognitive processes in the ICCS framework are: 


C 
[e 
civil institutions (the institu 
C 
C 


belonging, connectedness, 


society), and (iv) rule of law (equal and fair applicat 


and legal transparency). 
Civic participation (three sub- 
(i 

(i 


Civic identities (two sub-dom 
[e 


Knowing: This refers to the learned civic and citizenship information 


ivic society and systems (three sub-domains): (i) ci 
pportunities), (ii) state institutions (those central to civic governance and legislation), and (iii) 


tizens to pursue many of their roles in their societ 


ivic principles (four sub-domains): (i) equity (all people 
(ii) freedom (of belief, of speech, from fear, and from want), (iii) sense of community (sense of 


iii) community participation (volunteering, pa 


tizens (roles, rights, responsibilities, and 


tions that mediate citizens’ contact with state institutions and allow 


ies). 


having the right to fair and just treatment), 


and common vision among individuals and communities within a 


domains): (i) decision-ma 


ion of the law to all; separation of powers 


ing (organizational governance and voting), 
ii) influencing (debating, demonstrating, developing proposals, and selective purchasing), and 
rticipating in organizations, keeping informed). 


ains): (i) civic self-image (individuals' experience of their place in each 


in the more complex cognitive tasks that help them 


Reasoning and applying: This refers to the ways in 


information to reach conclusion 


process also refers to how 


students use these concl 


The assessment framework identified the different ty 
relevant to civics and citizens 
and (ii) engagement. 


Table 1.1 shows the emphasis given 
domains in the international studen 


sthatare broader than the conten 


make sense of 


which studen 


hip. Two affective-behavi 


pes of student 
oral domains were identified: (i) attitudes, 


f their civic communities), and (ii) civic connectedness (sense of connection to different civic 
ommunities and the civic roles individuals play within each community). ICCS also includes 


e 
global citizenship as a key concept relating to students’ civic identities. 


students use when engaging 
their civic worlds. 


ts use civic and citizenship 


ts of any single concept. This 
usions in real-world contexts. 


perceptions and behaviors 


Attitudes: These refer to judgments or evaluations regarding ideas, persons, objects, events, 


situations, and/or relations 


hips. They include students' beliefs about democracy and citizenship, 


students' attitudes toward the rights and responsibilities of groups in society, and students' 


attitudes toward institutio 


£ 


Engagement: This refers to 


efficacy). The notion of engagem 
forms of civic protest, anticipated 


participation in citizenship 


ns. 


students' civic engagement, students' expectations of future civic- 
related action, and students' dispositions to actively engage in society (interest, sense of 


activities. 


ent includes concepts such as preparedness to participate in 
future political participation as adults, and anticipated future 


to the different content, cognitive, and affective-behavioral 
tsurvey instruments (test and questionnaire). 


6 The ICCS 200? assessment framework had four affective-behavioral domains—value beliefs, attitudes, behavioral 
intentions, and behaviors. However, because of the difficulties encountered when distinguishing between (more deeply 
rooted) value beliefs and (narrower) attitudes, the ICCS 2016 team decided that ICCS 2016 should distinguish only 
between attitudes and engagement as affective-behavioral domains. 
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Table 1.1: Emphasis (shown as number of items) given to civic and citizenship education content in ICCS 
2016 student test and questionnaire 


Content domain 

Civic society Civic Civic Civic Total 

and systems principles participation | identities 
Cognitive domains 
Knowing 12 9 2 0 23 
Analyzing and reasoning 24 18 19 4 65 
Total 36 27 21 4 88 
Affective-behavioral domains 
Attitudes 42 21! 5 5 73 
Engagement 5 8 35 2 50 
Total 47 29 40 7 123 
European questionnaire SN 22 6 E 58 
Attitudes 
Latin American questionnaire bi S5 16 8 70 
Attitudes 


The ICCS contextual framework 


Studies of the outcomes of civic a 
civiclearning takes place. Young people develop their understandings about their roles as citizens 
through a number of activities and 


wider community. 


The context of the wider commu 
comprising students’ schools and h 
and (possibly) supranational contexts. The knowledge, competencies, dispositions, and self-beliefs 


that students possess are po 


Contextual influences on ci 


antecedents or processes. An 
and citizenship learning 


te 
regional, national, and supran 
andtheir learning environmen 
environments (their direct ho 
individual characteristics (whi 


a 


m 
C 


ntia 


eba 


h shape how 


ú 


for example, the extent of s 


Lakes place (e.g., thro 


tional levels), thei 
tsas wellast 


ckground an 


c and citizenshi 
tecedents refer 


ly influenced by factors related 


they respond to learni 


to the historical bac 


schools teach this area of educational provision. 


Contextua 


1.2). The (double-headed) arrow in the fi 
relationship. Feedback occurs between 
with higher levels of civic knowledge an 
in activities (at school, at home, and wi 


p education can also be conceptualized 
ground that affects how civics 
ugh historical factors and policies that s 
learning is provided). Processes contemporaneously shape civic and citizenship educat 
tudents' civic understanding and engagement can influence the way 


nd citizenship education need to consider the context in which 


experiences that take place in the home, school, classroom, and 


nity can be viewed as multi-layered, with the local community, 
ome environments, embedded within broader regional, national, 


totheir wider community (at local, 
r schools and classrooms (the instruction th 
he school culture they 


eyreceive 


experience), their home and peer 
dtheir social out-of-school environment 
ng about civics and ci 


,andtheir 


tizenship). 


as either 


hape how 
on. Thus, 


factors influence the learning outcomes of civic and citizenship education (Figure 
gure between processes and outcomes signals a reciprocal 
civic-related learning outcomes and processes. Students 
d engagement are the students most likely to participate 
thin the community) that promote these outcomes. The 


(single-headed) arrow between antecedents and processes describes the relationship between 
factors that are unidirectional. 


The different ICCS instruments collected data on several variables (or groups of variables; see Table 
1.2 for examples). The national contexts survey and other published data sources provided data 
on variables related primarily to the context of country and community. The school and teacher 
questionnaires collected data on variables related to the context of schools and classrooms. The 
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Figure 1.2: Contexts for the development of learning outcomes related to civics and citizenship 


Antecedents Processes Outcomes 


School/classroom School/classroom 


Characteristics Instruction 
Composition Governance 
Resources 


Student 
Socialization and 
learning 


Student 
Characteristics 


Table 1.2: Mapping of variables to the contextual framework (examples) 


Level of... Antecedents Processes Outcomes 
Wider community NCS & other sources: NCS & other sources: 
Democratic history Intended curriculum 
Structure of education Political developments 
School/classroom ScQ & TQ: ScQ & TQ: SCT & StQ/RQ: 
School characteristics Implemented curriculum Civic knowledge 
Resources Policies and practices Attitudes and 
Student StQ: StQ: engagement 
Gender Civic learning 
Age Civic engagement 
Home and peer StQ: StQ: 
environment Parent SES Family communication 
Ethnicity Communication with 
Language peers 
Country of birth Media information 


Note: NCS = national contexts survey; ScQ = school questionnaire; TQ = teacher questionnaire; 
RQ = regional questionnaire; StQ = student questionnaire; StT = student test; SES = socioeconomic status. 
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student background questionnaire also provided information on antecedents of the individual 
student and his or her home environment as well as on some relevant process-related variables (e.g., 
learning activities or classroom climate). The student test and parts of the student questionnaire 
relating to attitudes and engagement collected data on outcomes. 


Contexts assessed in ICCS 2016 


The context of the wider community also comprises several levels. Here, schools, as well as home 


and peer environments, are embedded within the local community. Th 


e local community, in turn, 


is embedded within broader regional and national contexts and possibly supranational or global 


contexts. Of these levels, ICCS deems community and national as the levels mos 


study. 


e [he context of the education system: ICCS 2016 col 


ected data on the struc 


t relevant to the 


ture of national 


education systems, the content of education policies, and approaches to civic and citizenship 


education. It also collected information on teacher 
regard to civic and citizenship education in particular focused on app 
n current debates and re 


and quality assurance and o 


E 


training in general. 


orms relating to thi 


[he d 


roaches 
s learning area. ICCS 


ata collected in 
Lo assessment 


2016 also used data from published sources and from the national contexts surveys to develop 


and compare profiles of civic and citi 


e [he context of the local community and schoo 


questionnaire gathered da 
Variables pertaining to the 
for citizenship learning 
promoting civic engagement 


affected school life. The 
in civic-related activities in 
or organizations in the 
participation in civic-related 


oca 


School contexts and characteristics in 
about civics and citizenship but also their dispositions and compe 
is the school's general ethos, cult 
civics and citizens 
t antecede 


as citizens. A major influence 
policies relating to both 
school questionnaire sought 


student participation at school, 


Theteacher questionnaire gath 
demographic characteristics (g 


in the loca 


obtained information on the existe 


community lev 


area (anteceden 


t), an 


-community relationships: 
ta on the contexts and characteristics of the lo 
el included urbanization (a 


zenship education in the participating countries. 
The ICCS school 


cal community. 


ntecedent), resources 
d civic-related activities directed at 


withinthe local community (process). The school questionnaire also 


| community. It 
activities in the 


and its community were committed to constructive relat 


formal and informal 
information on importan 
such as principals' characteristics and schools' characteristics and 
process-related variables concerning school manage 


anc 


ered information about 


ender, age) and 


at the target grade. The information collected 
their school culture and climate, their participa 


teaching. As in ICCS 2009, the 
that asked questions about civic 
the school had adopted in this 


CCS 2016 teac 


only by teachers of subjects re 


The student questionnaire mea 


fluence not only the deve 


learning area. T 


nce of social tensions 
teacher questionnaire collected d 
the local commu 


nity and 


teach 


ers’ personal 


nthe community and how this issue 
ata onteacher/student participation 
participation in groups 


also collected data about teachers’ and students’ 


local commun 


ionshi 


the implementation of civic and 


sured students’ 


ity an 


opme 


ment, schoo 


nt of young peo 


ure, and clima 


nt variables at 


climate, teac 


hip curricula are enacted. 
the school level, 
resources. It also asked about 
her, parent, and 


dthe extent to which the school 
ps between the 


CWO. 


ple’s knowledge 


tencies in relation to their roles 
te, within which 


The 


citizenship edu 


aspects of teaching. These included 
the subject(s) these teachers taught in general and 
also included teachers’ perceptions of aspects of 
tion in school decision-making, and aspects of their 
her questionnaire included an international option 
and citizenship education at school and about the teaching practices 
his last part of the questionnaire was completed 
ated to civic and citizenship education. 


cation at school. 


teachers’ 


perceptions of the school and classroom context. The 


measures included the classroom climate for civic and citizenship education, students’ reports on 
their civic learning experiences, students’ experience of verbal and physical abuse, and students’ 


perceptions of school climate. 
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The student questionnaire also asked students to report on home and peer contexts, including 
interactions. Within the context of civic and citizenship education, these contexts can have a 
considerable influence on the development of young people's knowledge, attitudes, and beliefs. 
The student questionnaire also contained questions about selected student characteristics such 


as age and gender and the level of educational qualification that the students expected to reach. 


Data collection and ICCS instruments 


The main survey data collectio 
2015 and June 2016. The surve 
calendar betwee 
calendar betwee 


Details relating 
and nat 


e [he88 items 


the internatio 


n October and 
n February and June 2016. 


measuring civic and citizenship k 


e The international student questionnaire took be 


used to obtain students’ perceptions about civics and citizensh 


each student’ 


S 


background. 


ng to a balanced rotated design. 
he test items were generally presented with 


n took place in the 24 participating countries between October 
y was carried out in countries with a Southern 
December 2015, and in those with a Northern 


emisphere school 
emisphere school 


to the 2016 instruments administered to students, teachers, school principals, 
ional centers follow. 


nowledge, analysis, and reasoning contained in 
nal student cognitive test were assigned to eight booklets (each of whi 
three of a total eight 11-item clusters) accordi 
completed one of the 45-minute booklets. T 
contextual material that served as a brief introduction to each item or set of items. 


ch contained 
Each student 


tween 30 and 40 minutes to complete and was 
ip as well as information about 


e The 30-minute teacher questionnaire asked respondents about their perceptions of civic and 


citizenship education in their schools. It also asked them to p 


schools’ organization and culture as well as their own teaching 


e The school questionnaire, 


which also took 30 minutes to comp 


rovide information about their 


assignments and backgrounds. 


ete, asked school principals to 


provide information about school characteristics, school culture and climate, and the provision 


of civic and citizenship ed 


ucation in the school. 


e National research coordinators (NRCs) compiled and synthesized th 
national experts in response to an online national contexts survey. This information concerned 


the structure of 
and recent developments in civi 


In addition to the international a 
options in the questionnaires and invited the 
options contained items concernin 
anumber of specific questions for 


Development of the ICCS instru 


The regional ins 


the education system, civic and citi 


truments, an in 


nation 
gstudents' ethnici 


nd regional instruments, ICCS of 


zenship educati 
c and citizenship education. 


einformation procured from 


on in the national curricula, 


fered several international 


al centers to consider using them. These 
ty, household composition, and religion, and 
teachers of civic and citizenship education. 


novative feature of ICCS 2009, were again made available to 


ICCS 2016 countries in regions with five or more participating countries. The purpose of the 
w assessment of region-specific aspects of civic and citizenship 


regional instrum 
education. Theq 
on particular iss 


ents was to allo 


participate in the regional optio 


The first phase consisted o 


£ 


assessment 


£ 


uestionsintheinstruments,whichtoo 


n. They were Europe and Latin America. 


ments was a three-phase process. 


roughly 15 minutes to answer, focused 
ues associated with civics and citizenship in the two regions that elected to 


the writing of test and questionnaire items guided by the ICCS 
ramework. The items were piloted in six countries and were also subject to 


extensive consultation with the NRCs and experts from fields such as social psychology and 


political studies. 
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coun 
teach 


The 
resu 


ers; 


Giventh 
for such 
thoroug 


eimportance of ensuring comparability and a 
adiverse range of participating countries, the ICCS field trial data were used to conduct a 
h review of the cross-national validity of both the test and the questionnaire items. 
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The second phase involved implementation of an international field trial in all participating 
tries and analysis of the data collected from 


smaller samples of schools, students, and 


third phase included a final revision of the material in light of the ICCS 2016 field trial 
ts and further feedback from national centers and expert consultants. 


ppropriateness of the measures inthis study 


Links to ICCS and reporting changes since 2009 


Twenty-one of the co 
studenttestitemsu 


ofthese items meant 


the same scale and compa 


schools, and nation 
2009 instruments, 


Although 21 countri 
onlythe changes for t 
with sampling, instru 
both cycles. This stip 
countries or all ques 
da 


a 


E 


Report context 


This publication reports on the findings from ICCS 2016.1 
nd Latin America, a technical report, a 
user guide. The six content-related chapters following this i 
The last (eighth) cha 


reports for Europe a 


a particular ICCS res 
general discussion of 


Chapter 2 describes 
It addresses commo 


Chapter 3 reports on 


measure civic and ci 
resultant scale. Chap 
the student characte 
with soci 


Chapter 
question 
new soci 
their civi 


naire, the ch 


Chapter 
The cha 


sedin CCS 2016, 


th 


tions and instru 


n pat 
and groups of countri 


oeconomic status and immigra 


al media), their level of interest 
c worlds, and the nature of their current and expected ci 


untries that part 


that student achi 


us allowing for 


s participated in both 
hose 
ment preparation, fi 


ulation means that o 


and scope 


earch question. 
outcomes. 


the national con 
terns as well as 


es: 


the 


tizenship knowled 


ter 3 alsoreports on 


apter reports on s 


red. The ICCS 2 
centers) also includ 


evels of civic and citize 
in civic content knowledge since 2009. It descri 


nt and lan 


(CCS 200 


countries where data collection 


texts for civic and ci 


interestin 


S 


q 


the relati 


eld operations, scoring, and 
ur reporting of changes over time does not cover all 21 
ments. The number of countries 
ta collected by the various questions and instruments consequently vary. 


bes how the ICCS cognitive tes 
ge, and it 
onships between student civic knowled 
ristics of age and gender as we 


icipated in ICCS 2009 also participated in ICCS 2016. Of the 
about half were sec 
evement in ICCS 2009 and ICCS 2016 could be reported on 
O16 questionnaire instruments (for students, teachers, 
ed selected se 
comparisons across 


ure items from ICCS 2009. The inclusion 


ts of questions from the corresponding 
the two cycles in these selected areas.’ 


9 and ICCS 2016, 
smetthe tec 


this current report presents 
hnical standards associated 
data management during 


included in comparisons of 


t will be comple 
nd an ICCS inte 
ntroductory ch 
pter concludes 


mented by the regional 
rnational database and 
apter typically focus on 
the report with a more 


tizenship education in ICCS countries. 
g policies and practices in specific countries 


hip knowledge across countries and changes 
t was used to 
pared on the 
ge and 


ics associated 


ocuments how countries com 


ll as student home characterist 


gu 


4 explores aspects of students' civic engagement. Drawing on data fron 
tudents' personal engage 
in political and social issues, their confidence to engage in 


age backgrounds. 


n the student 
ment with the media (including 


tizenship participation. 


5 focuses on issues relating to students' attitudes toward important issues in society. 
pter reports data associated with students' perceptions of de 


mocracy and citizenship 


7 Details of the equating procedures enabling comparison of the 2009 and 2016 results wi 


| be provided in the ICCS 2016 


technical report (Schulz, Carstens, Losito, & Fraillon, forthcoming). 
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and students' attitudes toward gender equality and rights for people from a range of ethnic and 
racial groups in their countries. The chapter also illustrates students' views on the seriousness of 


problems affecting the worl 


d,as well as on students’ trust in civic institutions, groups, and sources 


of information. The chapter concludes with a look at the attitudes of students in selected countries 
toward the influence of religion in society. 


Chapter 6 descri 


bes school and community contexts related to civic and citizenship education. This 


chapter includes data from the school, teacher, and student questionnaires. It reports on teachers' 


and students' participation 
students and schools inthei 


in schools. 


of student background, as 


engagement experiences and 


in school life, the quality of social interactions in schools, the place of 
rlocal communities as they pertain to civic-related activities, activities 
relating to environmental sustainability, and civic learning processes and teacher preparedness 


Chapter 7 considers the results of multilevel analyses of the relationships between aspects 


pects of civic learning, and other contexts of civic and citizenship 


education and students' civic knowledge. The chapter also reviews the results of the (single-level) 
multiple regression analyses designed to identify associations between student background, civic 
attitudes, civic knowledge, and two indicators of students' prospective 


engagement—expected electoral participation and more active political participation. 


Chapter 8 provides a summary of the main findings that e 


merged from ICCS 2016 in relation to 


its underlying research questions. It also discusses the possible implications of these findings for 


policy and practice. 
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CHAPTER 2: 


National contexts for civic and citizenship 
education 


Chapter highlights 
Socioeconomic and political contexts vary considerably across the ICCS 2016 countries. 


e The populations of the countries surveyed in ICCS 2016 vary considerably in size. 
(Table 2.1) 


e The countries also differ substantially with respect to Human Development Index (HDI) 
scores and Gross Domestic Product (GDP) per capita. (Table 2.1) 


e There were large differences between countries in voter turnout during their (respective) 
most recent legislative election prior to ICCS 2016. (Table 2.2) 


e Literacy rates in the participating countries are relatively high. (Table 2.3) 


The extent to which schools have autonomy in decision-making processes for school 
management varied substantially across participating countries. 


e |n the majority of the countries, schools had a large degree of autonomy with respect to 
allocating resources to the various components of their total school budget. (Table 2.4) 


e On average in most of the participating countries, schools also had a large degree of 
autonomy when planning activities relating to their civic and citizenship education (such 
as curriculum development, teachers' professional development, and organization of 
extracurricular activities). (Table 2.5) 


Education systems and schools in participating countries apply a variety of approaches to 
teaching civic and citizenship education. 


e Countries were teaching civic and citizenship education either as separate subjects, through 
subjects related to human or social sciences, or as content integrated into all subjects in 
the school. Some countries considered civic and citizenship education to be an integrated 
part of the whole school experience. (Table 2.6) 


e Widespread consensus across the participating countries was evident with regard to learning 
objectives for civic and citizenship education at the target grade. (Table 2.7) 


e |n most of the participating countries, principals and teachers regarded promotion of 
students’ knowledge of citizens’ rights and responsibilities, promotion of students’ critical 
and independent thinking, and promotion of students’ respect for and safeguard of the 
environment as important goals of civic and citizenship education. (Tables 2.8, 2.9) 

All participating countries were providing some form of teacher in-service and pre-service 

training in the area of civic and citizenship education. 

e National study centers in all countries advised that civic and citizenship education is a part 


of training for teachers of subjects related to civic and citizenship education, either at the pre- 
service level, the in-service level, or both. (Table 2.10) 


e Teachers’ participation in professional development activities relating to the teaching of civic 
and citizenship education differed widely across countries. (Table 2.11) 
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rch 


illon, Losito, & Agrusti, 2016) states that 


any study of civic-related learning outcomes and civic engagement must consider the contexts in 
which civic and citizenship education occur. The framework identifies four levels of overlapping 
contexts, each of which is a factor potentially influencing this learn 


e Context of the wider community: This level comprises the wider 


homes, and peer environments are situated. Releva 


ntfactors can 


national levels. For some countries, the supranational level (suc 
also be of relevance. Given the growing importance of new soc 
connected through the internet also form part of broader changing political, social, and economic 


contexts. 
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ing area: 
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be found at local, regional, and 


European Union) may 


ial media, virtual communities 


e Context of schools and classrooms: This level includes factors related to the instruction students 
receive, the culture of the school, classroom climate, and the general school environment. 


e Context of home and peer environments: This level consists of factors related to students’ home 


backgrounds and to students' immediate social o 
norms and activities). 


e Context of the individual: This level refers to the ind 


ut-of-school environment (e.g., peer-group 


ividual characteristics of the student. 


Inthis chapter, we explore the national contexts of civic and citizenship education in the 24 countries 


that participated in ICCS 2016. The chapter addresses 


two general research questions in particular: 


RQ 1: How is civic and citizenship education implemented in the participating countries? This question 


is accompanied by a sub-set of three questions: 


(a) Which curricular approaches do participating countries choose to provide civic and citizenship 
education? For example, is the learning area taught as a separate subject or is it integrated in 


other subjects and/or school activities? 


(b) What are the aims and principles of civic and citizenship education in each participating country? 


(c) What changes and/or developments in this learning a 


ea can be observed since 2009? 


RQ 5: How are schools in the participating countries organized with regard to civic and citizenship 


education, and what is its association with students’ learnin 


by a sub-set of two questions: 


(a) What are the general approaches to civic and citizen 
content structure and delivery? For example, are t 
professional training of teachers who deliver civic and citizensh 

(b) How do schools and teachers perceive the role of civic and citizenship 
countries? For example, are there differences in principals' and 
relative importance of different aims of civic and citizenship educat 


here differen 
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ship education, curriculum, and/or program 
ces across countries in the 
ip education? 

education across participating 


teachers' perceptions of the 
ion? 


Our exploration of these questions draws not only on data collected via the ICCS 2016 


questionnaires for national centers, principals, and teachers but also on da 


tafrom external sources. 


We begin by discussing the sources of the data, in particular the national contexts survey (NCS) 


and its development. We next discuss the participating countries' educati 
contexts. From there, we examine profiles of civic and citizenship curric 


on systems and national 
ula and approaches. We 


conclude with a discussion of the contexts within which teacher preparation with respect to civic 


and citizenship education takes place. 


1 Because of the sampling design for ICCS, school level and classroom level cannot be disentangled. Typically, only one 


classroom was selected within each sampled school. 
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The national contexts survey was completed by each national center responsible for coordinating 
the ICCS study within their country. ICCS asked the centers to draw on available expertise and 
reference resource documents from their perspective countries. As a consequence, the information 
reported in this chapter from this data source is the perspective of the respondents to the 
survey (whose number varied across countries, depending on each national center's approach to 
completing the survey). Also, we advise readers, when considering portrayals of the design and 
delivery aspects of civic and citizenship education in the individual countries, to be aware that other 


research has identified gaps between policies and practices in this area of educational provision. 


The ICCS 2016 NCS incorporates many of the aspects included in the previous survey in 2009. 
We updated some content areas to reflect the revised research questions, and modified other 
questions in order to improve data quality. We also included some new questions to capture 
changes to the structure of the countries' education systems or to the way in which the countries 
have conceptualized and delivered civic and citizenship since 2009. The final questionnaire included 
29 questions covering four broad areas: 
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Assessments and quality assurance. 
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Education systems and national contexts 
Table 2.1, which presents selected demographic and economic characteristics of the countries 
surveyed in ICCS 2016, shows that the countries vary considerably in terms of population size. 
Of the 24 countries, Malta is by far the smallest, with a population of just over 431,000. Half of 
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es currently have 18 years as the minimum legal age for voting 


(22 out of 24 countries). Only the Republic of Korea (19 years) and Chinese Taipei (20 years) 


have slightly higher minimum lega 


voting ages. There is also little variation in whether voting is 


compulsory or not. People are not compelled to vote in 20 of the participating countries. The four 
countries where voting is a legal requirement are Belgium (Flemish), the Dominican Republic, 
Mexico, and Peru. These countries vary, however, in their enforcement of that requirement. 
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Table 2.1: Selected demographic and economic characteristics of ICCS 2016 countries 


Country Population size Human Development Index Gross Domestic Product 
(in thousands) (GDP) per capita 
Value Rank Category (in USD $) 
Belgium (Flemish) 6,477.80 ! 0.896? 22 Very high 41,138? 
Bulgaria Toa gn en 0.794 56 ig 6,956 
Chile 17,948.14 0.847 38 Very high 22,145 
Chinese Taipei 23,464.79 ? 0.882 4 2 Very high 47,800 ? 
Colombia 48,228.70 0.727 95 ig 2,988 
Croatia 4,203.60 0.827 45 Very high 20,430 
Denmark 5,683.48 0.925 5 Very high 43,415 
Dominican Republic 10,528.39 0.722 99 ig oo 
Estonia 1,314.61 0.865 30 Very high 26,930 
Finland 5 49 53 0.895 23 Very high 38,643 
Hong Kong SAR 7,305.70 0.917 12 Very high 53,380 
taly 60,730.58 0.887 26 Very high 33,587 
orea, Republic of 50,617.04 0.901 18 Very high 34,387 
Latvia aou 0.830 44 Very high 22,628 
Lithuania 2,904.91 0.848 37 Very high 26,397 
alta 431.87 0.856 33 Very high 28,822 
exico 127,017.22 0.762 77 igh 16,502 
etherlands 16,939.92 0.924 Jn Very hig 46,374 
orway 5,190.24 0.949 1 Very hig 64,451 
Peru 3137667 0.740 87 igh 13:672 
Russian Federation 144,096.87 0.804 49 Very hig 23,895 
Slovenia 2063.53 0.890 25 Very high 28,942 
Sweden 9,799.19 0.913 14 Very hig 45,296 
Benchmarking participant 
North Rhine-Westphalia dese (0,926:5 4 Very high 44.053 $ 
(Germany) 


Data on Human Development Index and GDP per capita obtained from Human Development Report 2016 unless otherwise stated. 
Data on population size sourced from World Bank Indicators unless otherwise stated. 


Notes: 
* Source: http://statbel.fgov.be/nl/statistieken/cijfers/bevolking. 
2 Data refer to the whole of Belgium. 
3 Data estimated for 2016. Source: https://www.cia.gov/library/publications/the-world-factbook/geos/tw.html. 

^ Data estimated for 2014. Source: http://focustaiwan.tw/news/asoc/201409 180039.aspx. 

5 Based on 2011 data. Source: https://www3.arbeitsagentur.de/web/content/DE/service/Ueberuns/Regionaldirektionen/ 
ordrheinWestfalen/ZahlenDatenFakten/Strukturdaten/index.htm. 

5 Data refer to the whole of Germany. 


The countries varied markedly with respect to voter turnout during their most recent legislative 
elections. Turnouts of more than 90 percent of eligible voters occurred in Malta, which does not 
have compulsory voting, and Belgium (Flemish)? where voting is compulsory. Less than half of 
eligible voters chose to vote in the most recent elections preceding the study in Chile, Colombia, 
and Mexico (voting is compulsory in Mexico, but not enforced). The composition of the parliaments 
brought in after the elections also varied quite substantially. The members of parliament in 
alta belong to only two different political parties, whereas in Colombia, Hong Kong SAR, and 
the Netherlands, members of parliament (MPs) represent between 11 and 14 different parties. 
Although no country participating in ICCS 2016 had equal representation of females in parliament, 
in five participating countries (Belgium/Flemish, Finland, Mexico, Norway and Sweden) women 
represented between 40 and 44 percent of MPs. One third of participating countries had less 
than 20 percent female representation. 


2 For Belgium (Flemish), this information refers to voting for representatives of the regional parliament of Flanders. 
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Table 2.2: Selected political characteristics of ICCS 2016 countries 


Country Legal age Compulsory Percentages of voter Number of Percentages of 
of voting voting turnout at last legislative political parties seats held by 
(Y/N) election prior to study in parliament women in 
(year of election) parliament 
Belgium (Flemish) 18 Y 92.5 2014)! Kë 44 ! 
Bulgaria 8 Zr 2014) 8 20 
Chile 18 49.3 2013) 8* 16 * 
Chinese Taipei 20 66.0 2016) 5 38 
Colombia 18 43.6 2014) 14* 19 * 
Croatia 18 60.8 2015 9 15) 
Denmark 18 85.9 2015) 9 37 
Dominican Republic 18 Y 69.6 2016) JO bs 
Estonia 184 64.2 2015 6 24 
Finland 18 701 2015 9 42 
Hong Kong SAR 8 58.0 2012 14 6 
taly 8 75:2. 2019 7 G 
orea, Republic of 9 58.0 2016 5 7 
Latvia 8 59:9 2014 ó 9 
Lithuania 8 52.9 2012 8 24 
alta 8 99) 2013 2 4 
exico 8 Y 47.7 2015 9 42 
etherlands 8 74.6 2012 Et Gor 
orway 8 78.2 (2013 8 40 
Peru 8 Y 82.0 2016 6 28 
Russian Federation 8 60.1 2011 4* 4* 
Slovenia 8 SE 2014 or eu S 
Sweden 8 85.8 2014 8 44 
Benchmarking participant 
North Rhine-Westphalia 8 5969 2012)9 5 2 
(Germany) 
Data for this table were collected from IPU Parline database unless otherwise stated. 
Notes: 
1 Data refer to the Flemish regional parliament. Source: http://polling2014.belgium.be/en/vla/results/results_start.html. 
? Dataobtained from CIA World Factbook. 
3 Data refer to North Rhine-Westphalia parliament. 
^ Exception for local elections where legal age is 16. 
* Bicameral structured parliament. Data refer to lower house. 
The selected education characteristics of ICCS 2016 countries shown in Table 2.3 include (a) the 
proportion of adults who are literate; (b) the relative spending of the government on education; 


and (c) the proportion o 


f the population who have access 


the countries participating in ICCS 2016 are high. The data 
European countries, with slightly lower rates in Colombia, 


SAR, Malta, Mexico, and 


The four participating 


Peru. 


ordic countries (Denmar 


, Finland 


, Norway, Sweden) have the 


to the internet. The literacy rates in 
show near universal adult literacy in 
the Dominican Republic, Hong Kong 


highest 


relative expenditure on education. Expenditure, presented as a percentage of GDP in Table 2.3, 
ranges from 7.2 to 8.5 percent of GDP across the four count 
lowest relative expenditure—just 2.1 percent of its GDP—on education. The proportion of the 


population with access to the inter 
lowest proportion evident in Peru (4196) and the h 


net vary considerably across parti 
ighest in Norway (9796). 


ries. The Dominican Republic has the 


cipating countries, with the 
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Table 2.3: Selected education characteristics of ICCS 2016 countries 


Country Adult literacy Public expenditure on Internet access 
rate (%) education (% of GDP) (% of population) 
Belgium (Flemish) 99 *? 6.4 ? 85? 
Bulgaria 98 35 57 
Chile 97 4.6 64 
Chinese Taipei 99 ! 4.3 88 
Colombia 95 4.7 56 
Croatia E 4.2 70 
Denmark 99 * 8.5 96 
Dominican Republic 92 eu 52 
Estonia 100 4.7 88 
Finland 100 * 7.2 93 
Hong Kong SAR 94 * 3.6 85 
taly 99 4.1 66 
orea, Republic of 98 * 4.6 90 
Latvia 100 4.9 79 
Lithuania 100 4.8 71 
alta 94 6.8 76 
exico 94 5.2 57 
etherlands Ei" SO 93 
orway 100 * 74 97 
Peru 75 ov] 41 
Russian Federation 100 4.2 79 
Slovenia 100 53 3 
Sweden 99 * 7.7 91 
Benchmarking participant 
North Rhine-Westphalia EIS bus 88 3 
(Germany) 


Adult literacy rate data obtained 


rom Human Development Report 20 


16 unless otherwise stated and refer to the percentage of the 


population 15 years of age and over who can read and write. Data re 
Public expenditure on education data obtained from Human Development Report 2016 unless otherwise stated. Data relate to collection 


period between 2010 and 2014. 


ate to collection period between 2005 and 2015. 


Internet access data obtained from CIA World Factbook and relate to 2015. 


Notes: 
1 Data obtained from CIA Worl 


d Factbook and relate to 2015. 


2 Data refer to the whole of Belgium. 
3 Data refer to the whole of Germany. 
* Recent estimates unavailable. Data sourced from CIA World Factbook and relate to 2000 to 2004. 


Level of autonomy in school decision-making 


The ICCS 2016 na 


tional contexts survey asked the study’s national research centers to provide 


information about how much autonomy the lower-secondary schools in their countries have with 
regard to making decisions about five school processes: (a) allocating resources; (b) planning 


curricula; (c) deter 
appointing teachers; a 
five decision-makin 
decreasing levels of 


au 


In 11 coun 


ne 


tries, resource allocation appears to be 


other resources. 


o school 
curriculum 


authorities. The remaining six national centers i 
countries have an even greater degree of autonomy in their ability to allocate teach 


in the 24 countries has full autonom 
. However, the national centers in 17 countries indicated that while schools must follow 


determined by regional or centra 
ndicated that the schools in thei 


y over determining or implemen 


mining pedagogical practice and approaches to teaching; (d) recruiting and 
nd (e) assessing students' achievement. When considering each of the 
g processes, respondents were asked to select from three optio 


ns reflecting 


Lonom higher; "some; and "lower? Table 2.4 presents the findings. 


educational 
r respective 
ing time and 


ting its own 
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Table 2.4: Level of autonomy of individual schools in decision-making processes in participating countries as 
reported by the ICCS 2016 national contexts survey 


Country Allocating Curriculum Pedagogyor |Recruiting and Student 
resources planning approaches to appointing assessment 
teaching teaching staff 
Belgium (Flemish) ° © e e e 
Bulgaria © = ° @ ° 
Chile w ° e e e 
Chinese Taipei © © e © e 
Colombia O © e O ei 
Croatia O O ° s ° 
Denmark e © © e ° 
Dominican Republic O O CO O ° 
Estonia © © e e © 
Finland e © e © e 
Hong Kong SAR s © ° © ° 
taly e ep e O > 
orea, Republic of E - °e Oo © 
Latvia e ei e e e 
Lithuania O © © @ °@ 
alta ° O = O = 
exico O O O O © 
etherlands e © e e ° 
orway © O e e © 
Peru O © O © ° 
Russian Federation e © e e v 
Slovenia O O © e © 
Sweden e O [9] e ° 
Benchmarking participant 
North Rhine-Westphalia ° v e s e 
(Germany) 


@ = Higher degree of autonomy 
@ = Some degree of autonomy 
O = Lower degree of autonomy 


some general official curriculum guidelines, they can influence curriculum content and delivery. 
In the remaining seven countries, schools are required to follow curriculums defined and planned 
by educational authorities. 


National centers in 12 countries said schools have a relatively high degree of autonomy when 
determining their general approaches to pedagogy or teaching; the centers in nine other countries 
reported only some degree of autonomy over decisions about teaching approaches. The centers 
in the remaining three countries said the schools there have a lower degree of autonomy over 
pedagogical approaches because the schools are generally required to follow system-wide 
recommended approaches. 


According to the national centers in just over half of the participating countries (13), schools have 
relatively high levels of autonomy with respect to recruiting and appointing teaching staff. The 
national centers in five countries reported some degree of school autonomy in this area, while the 
centers in the remaining six countries said schools have little autonomy over teacher recruitment 
and appointment. In those six countries, staff recruitment and appointments are typically conducted 
at a regional or central level. In six countries, national centers said their lower-secondary schools 
have arelatively high level of autonomy over student assessment. The results for the remaining 19 
countries indicated only some degree of autonomy in relation to assessing student achievement. 
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Level of autonomy in planning civic and citizenship education at school 
(CCS 2016 also investigated the level of autonomy lower-secondary schools in the ICCS 2016 


countries have wh 
of their civic and c 
they have the pote 


to affect the succe 
Bakkum, 2011; Sch 


The ICCS 2016 sc 
the level of autono 


and citizenship educatio 


planning; (d) teac 
education; (e) orga 


en planning 
itizenship ed 
ntial to influen 
ss of efforts d 
eerens, 2013; 


an 


Reez 


uestionnaire a 
eir schools had 
n: (a) choice of 
in-service pro 


hool q 
my th 


hers' 


schools. Table 2.5s 


"full" or "quite a lot" 


the participati 
high level of a 


The principals responses indicated that, on average cross-nationally, the aspect fo 
test autonomy is organizing extracurricular activities while the least 
sional development. Ninety-one percent of students were at schools where principals 
reported having a very high degree of autonomy over organizing extracurricular ac 
untry recorded a percentage below 7096). The corresponding percentage for teachers' in-service 
evelopment was 79 percent. 


have the grea 
service profes 


CO 
professional d 


A 


arge ma 
considerab 
percentage 
sameintern 
witho 
The countri 
witho 
(45%), and 


eau 


atio 


est 


Peru (5 


We observed greater variation across countr 


ng countri 


NOWS 


nization of extracurri 
the percentages of students 
of autonomy in relati 


over 


fessio 


onto 


es, most stude 


4%). 


tonomy over establishing stud 
s recorded for this aspect were in 
nal average (that is, 86%) for au 


ccordi 


textbooks; ( 


cular activiti 


d organizing curricular, teaching, and 
ucation. ICCS was interested in explorin 
ce the delivery of civic and citizenship education 
irected toward improving this area of 
igt & Creemers, 2005). 


ngly included a 
planning the fo 
b) assess 
velopme 
es; and( 
in schoo 


nal de 


nts were stu 
utonomy over all of the aspects considered. 


set of items as 
lowing specific 


f) participating i 
swhere principals reported they had 


the different as 


levels were th 


tonomy when es 


jority of the ICCS students (an international average of 86%) were at schools wi 
ent assessment procedures and tools. The lowest 
Denmark (6596) and Malta (5696). We recorded t 
tablishing cooperation agreements 
rganizations and institutions. Mexico recorded the lowest percentage for this aspect (6096). 
hat recorded the lowest percentages for parti 
ther schools at national and internationa 


e 


education 


ment and evaluation; 
nt specific to civic an 


earning-activity aspects 
gth 


ese aspects because 
in schools and 
(Sammons & 


ing principals about 
aspects of their civic 
C) curriculum 
d citizenship 


pects considered. On av 
dying at schools where princi 


cipation in projects in partnersh 
Dominican Republic (5996), Mexico 


n projects with other 


erage across 
s reported a 


pa 


r which schools 
is teachers’ in- 


tivities (not one 


th 


ne 


ip 


ies with regard to school autonomy over choice of 


textbooks and teaching materials. The ICCS 2016 average of students studying at schools with 


autono 


my for this aspect was 85 percent; we recorded si 


gnificantly lower percentages in Mexico 


(73%), Chile (67%), Malta (49%), the Dominican Republic (41%), and Peru (37%). 


Accord 
studyin 
educati 
percen 


ing to the information provided by principals, th 
g at schools with a good degree of freedom over planning their civic and citizenship 
oncurricula (ICCS 2016 international average: 80 
tages statistically significantly below the intern 


e ICCS 2016 students were generally 


96). However, several countries recorded 
ational average for this aspect. Those 


countries were the Dominican Republic (6696), Mexico (6896), Malta (50%), Slovenia (4996), and 


Belgium (Flemish) 


(2796). 
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Profiles of civic and citizenship curricula and approaches 


Oneofthe key findings from ICCS 2009 was the diversity inthe participating countries'approaches 
to delivering civic and citizenship education (Ainley et al., 2013; Schulz et al., 2010). When 
completing the national contexts survey, national research centers provided information on how, 
based on official documentation, the schools in their respective countries are meant to teach civic 
and citizenship education at the target grade in schools. Table 2.6 presents the responses to this 
question. 


n 11 countries, the expectation is for civic and citizenship education to be taught as a separate 
subject to students at the target grade. In all countries, with the exception of Colombia and Estonia, 
principals said that the intended teachers of this area of education are those who teach subjects 
related to human and social sciences. In 18 of the 24 ICCS 2016 countries, national centers also 
reported as afairly common expectation integrating civic and citizenship education into all subjects 
in the school. The centers in nine countries (Bulgaria, Chinese Taipei, Croatia, Estonia, Hong Kong 
SAR, Lithuania, Netherlands, Norway, Russian Federation) said that civic and citizenship education 
can be approached as an extracurricular activity, while the respondents from 15 countries said 
that civic and citizenship education is meant to be the result of the school experience as a whole. 


=, 


+ 


Table 2.6: Intended approaches to civic and citizenship education in the curriculum for target-grade students in participating 
countries as reported by the ICCS 2016 national contexts survey 


Approaches to civic and citizenship education at the target grade 
Country Taught as a Taught by Integrated into all | An extracurricular Considered the 
separate subject by | teachersof subjects | subjects taught at activity result of school 
teachers of subjects | related to human/ school experience as a 
related to civic social sciences (e.g., whole 
and citizenship history, geography, 
education law, economics) 

Belgium (Flemish) e e e 
Bulgaria e e e e 
Chile e e e 
Chinese Taipei e CO [5] e e 
Colombia e 
Croatia o e e 
Denmark o e e e 
Dominican Republic [S] e 
Estonia Oo e o 
Finland o e e e 
Hong Kong SAR e e e e e 
taly e e @ 

orea, Republic of e 
Latvia e e 
Lithuania e e e e 

alta e 

exico e e e 

etherlands e e 

orway e e e e e 
Peru e e 
Russian Federation e e e e 
Slovenia e e e e 
Sweden e e e 
Benchmarking participant 

orth Rhine-Westphalia e e e e 
(Germany) 
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Aims of civic and citizenship education 
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The national contexts survey asked national centers to indicate whether the curriculum for 


the ICCS 2016 target grade spec 
education provision. Table 2.7 sum 


objective, "knowing basiccivic and citizenship facts (e.g. about political institutions and processes) 


ified certai 


n learning objectives in their civic and citizenship 


marizes the responses to this question from the 23 countries 
that completed it. The table reveals a great deal of commonality in the specification of learning 
objectives across countries, with all 23 specifying "understanding key civic and citizenship concepts 
(e.g. democracy, rights and responsibilities)" as an objective. The second most commonly reported 


n 
š 


was identified in 22 countries. It was closely followed by “communicating through discussion and 
| centers in 20 countries specified “understanding key civic and 


debate" (21 countries). The nationa 
citizenship values and attitudes (e. 
did the centers in another 20 coun 


"Understanding decision-making 
toward participation and engagem 


g. fairness, respo 


ent" were cited a 


respectively. Slightly smaller numbers of countries 


community-based activities and un 
"becoming involved in decision-ma 


derstanding how 
ing in the school 


and allegiance" (16 countries each). 


ThelCCS 2016 survey asked princi 
of different aims of civic and citize 
asked respondents to select from 
important aims of civic and citizens 


C 
G 

conflict resolution; (e) promoting k 
students’ participation in the «local 
t 


effective strategies to reduce racis 


1) Civicand political knowledge 


( 
(2) Sense of responsibility (development of)—items b, c, and i; and 
( 


hinking; (h) promoting students' participation in 


(CCS organized these aims into three main conce 


pals and teachers 


the following list 
hip education: (a) 


ivic institutions; (b) promoting respect for and safe 
apacity to defend one's own point 


m; and (j) prepari 


tries for "understanding the principles of voting and electi 


of view; (d) developing students' skills and competencies in 
nowledge of citizens' rights and responsibilities; (f) promoting 
community»; (g) promoting students’ critical and independent 
school life; (i) supporting the development of 


nsibility, or engagement)" as an objective, as 


n 


ons. 


and active participation" and "developing positive attitudes 


s learning objectives in 19 and 18 countries, 
specified the objectives of "participating in 
to resolve conflicts" (17 countries each) and 
" and "developing a sense of national identity 


to provide information about the importance 


nship education. The school and teacher questionnaires both 


what they considered to be the three most 
promoting knowledge of social, political, and 
guard of the environment; (c) promoting the 


ng students for future political engagement. 


ptual areas: 


and skills (development of)—items a, d, e, and g; 


3) Active participation (development of)—items f, 


Table 2.8 shows the national percen 
preferences for each ind 


first category—civic and political knowledge and skil 


the highest percentages of studen 


ts (6496) were re 


"promoting students critical and independent thinkin 
were for "promoting students' knowledge of citiz 
"developing students' skills and competencies in con 


Lower average percentages of stud 


to aims included in the active partici 


ents were eviden 
pation area. The 


h, and j. 


tages of students studying at schools where principals reported 
ividual aim. The aims perce 


ived as the most important all fell within the 
s. On average across participating countries, 
corded for schools where principals viewed 
g asimportant. The next highest percentages 
ens' rights and responsibilities" (6196) and 
flict resolution" (4496).3 


t at schools where principals gave preference 
percentages across countries with respect to 


3 Although we cannot directly compare the overall results from ICCS 2009 with the ICCS 2016 findings because of 
changes in the composition of country participation, it is interesting to note that in the 2009 survey, school principals 
indicated the following aims as the most important ones: "promoting students' knowledge of citizens' rights and 
responsibilities" (international average percentage of students: 6696), “promoting students' critical and independent 
thinking" (5596), and "promoting students' knowledge of social, political, and civic institutions" (4296). 
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these aims varied markedly, as was the case with 


Our comparison of the results from the school and 


“ 


promotion of respect for and safeguard of the 


environment” The average percentages of students studying at schools where principals chose 
this aim as an important one ranged from 10 percent in Denmark to 70 percent in Malta. 


On average across the participating countries, the aims of citizenship and civic education that 
teachers most frequently chose as the three most important ones (refer Table 2.9) were "promoting 
students' independent and critical thinking" (6196), "promoting knowledge of citizens' rights and 
responsibilities" (5596), and "promoting respect for and safeguard of the environment" (5196). The 
CCS 2016 average percentage of teachers choosing "developing students' skills and competencies 
in conflict resolution" was 47 percent, while the corresponding percentage for "promoting students’ 
nowledge of social, political, and civic institutions" was 29 percent. 


teacher surveys? revealed relatively widespread 


consensus that promoting students' critical and independent thinking, promoting students' 


£ 


conflict resolution are important objectives o 
relatively large proportions of teachers across th 


Contexts for teacher preparation 


The national contexts survey (NCS) asked nationa 


nowledge of citizens' right and responsibilities, and developing students' abilities to resolve 
civic and citizenship education. However, although 
e ICCS countries saw the promotion of respect 
for and safeguard of the environment as one of the important goals, the results from the school 
survey suggest somewhat more variation with regard to school principals' perceptions of the 
importance of learning about environmental prot 


ection. 


centers to indicate whether civic and citizenship 


education was a mandatory part of teacher education at the pre-service level and at the in-service 
level for different groups of target-grade teachers. The centers in all of the ICCS 2016 countries 
said that civic and citizenship education is part of teacher training for teachers of subjects related 
to civic and citizenship education, either at the pre-service level, the in-service level, or both (see 


Table 2.10). 


In 19 ofthe 24 participating countries (the exceptions were Colombia, Croatia, Dominican Republic, 
Hong Kong SAR, and Slovenia), civic and citizenship education is, according to the national centers, 
mandatory at the pre-service level for at least some teachers. In 18 of these countries, training is 
available for pre-service teachers of subjects related to civic and citizenship education. Seven of 
the 18 national centers advised that pre-service training is on offer to specialist teachers of civic 
and citizenship education. In the benchmarking participant North Rhine-Westphalia (Germany), 
only specialist teachers have access to this type of training. Seven countries also offer this type of 
pre-service education to teachers teaching subjects not related to civic and citizenship education. 


The national centers in 20 countries said that their countries provide some form of in-service 
training in civic and citizenship education for teachers of subjects related to this learning area 
(the exceptions were Denmark, Korea, the Netherlands, and Norway). Of these 20 countries, 11 
were, according to the respective national centers, offering training to specialist teachers of civic 
and citizenship education, while the centers in another 13 countries advised that training is also 
available to teachers of subjects not related to civic and citizenship education. 


The ICCS 2016 teacher questionnaire also included a set of questions administered only to target- 
grade teachers of subjects that each national context regarded as part of civic and citizenship 
education.? These questions included a question about the opportunities teachers have to 
participate in professional development courses on the following topics during their pre-service 


4 We advise readers to treat comparisons with due caution given that school principals' perceptions are reported at the 
student level, while the teachers' perceptions pertain to the teacher population. 


5 National centers were asked to identify those subjects. 
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Table 2.10: Civic and citizenship education in initial and in-service training of target-grade teachers as reported by the ICCS 2016 


national contexts survey 


Civic and citizenship education mandatory part of In-service, continuing education, or professional 
preservice/initial teacher education? development for civic and citizenship education offered? 
Country Specialist Teachers of Teachers of Specialist Teachers of Teachers 
teachers subjects related | subjects not teachers subjects related | subjects not 
to civic and related to civic to civic and related to civic 
and citizenship | and citizenship and citizenship | and citizenship 
education education education education 
Belgium (Flemish) e e o e 
Bulgaria e e e 
Chile e e 
Chinese Taipei e @ e @ 
Colombia e e e 
Croatia o e 
Denmark e e 
Dominican Republic e 
Estonia e e e e e e 
Finland @ e 
Hong Kong SAR e e e 
taly e e e e 
orea, Republic of e 
Latvia e [9] e e e e 
Lithuania e e e e 
alta [9] e e 
exico e e e e e e 
etherlands e 
orway e e e 
Peru e e @ e 
Russian Federation e e e e 
Slovenia e 
Sweden e e e e 
Benchmarking participant 
North Rhine-Westphalia [9] e e e 
(Germany) 
and/or in-service training: (a) human rights; (b) voting and elections; (c) the global community and 
international organizations; (d) the environment and environmental sustainability; (e) emigration 
and immigration; (f) equal opportunities for men and women; (g) citizens' rights and responsibilities; 


(h) the constitution 
social medi 
Union (for 


Table 2.11 shows the national percentages of teachers of c 
training courses on 


they had opportun 


(6596), responsible internet 


and responsibilities (5 
rights (5896). 


The 


Civic 


and polit 
a); (j) critical and 
European countries only). 


ity to par 


results also showed considerab 
teachers said they had opportunities to engage in professional d 
and citizenship education. Although in Croatia and Norway, for example, less than 


ticipate in 


use (6196 
996). the environ 


ed 


ical systems; (i) responsible internet use (e.g. privacy, source 
independent thinking; (k) conflict resolution; and (I) the 


ivic and citizenship educati 


sustainability (5896), a 


ifferences across countries in terms of the exten 
evelopment relevant to teaching 


teachers reported not having received training relevant to any of the topics, more than 


teachers in Latvia and Peru indicated that they had participated 


all of the topics included in this question. 


on 
topics related to this learning area. On 
average across participating countries, the highest percentages pertained to conflict resolution 
, critical and independent thinking (6196), citi 
ment and environmenta 


zens' rights 


reliability, 
European 


who said 


nd human 


tto whi 


half of t 
half of t 


in professional develo 


pment f 
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CHAPTER 3: 


Students' civic knowledge 


Chapter highlights 


Civic knowledge can be described across four levels of increasing complexity. 


e Students working at Level D demonstrate familiarity with concrete, explicit content and 
examples relating to the basic features of democracy. 


3 


e Students working at Level C engage with the fundamental principles and broad concepts 
that underpin civics and citizenship. 
e Students working at Level B demonstrate some specific knowledge and understanding of 
the most pervasive civic and citizenship institutions, systems, and concepts. 


e Students working at Level A demonstrate a holistic knowledge and understanding of civic 
and citizenship concepts and demonstrate some critical perspective. (Figure 3.1) 


Civic knowledge varied more within countries than across countries. 

e The median range between the lowest five percent and the highest 95 percent of student 
Civic knowledge scores within countries spanned more than three levels on the ICCS civic 
knowledge scale. 

e The range of average civic knowledge scores across countries spanned two-and-a-half 
levels on the ICCS civic knowledge scale. (Table 3.9) 


Civic knowledge has increased since 2009. 


e Across the 18 countries that participated in ICCS 2009 and ICCS 2016, the proportion of 
students achieving at Level B and above on the civic knowledge scale increased from 61 
percent to 67 percent. (Table 3.11) 


e Elevenofthese 18 countries recorded a statistically significant increase in average student 
civic knowledge. (Table 3.12) 


Civic knowledge was associated with student gender. 
e Female students demonstrated higher civic knowledge than male students. 


e [heaveragecivic knowledge scores of female students was statistically significantly higher 
than that of male students in 19 of 21 countries. 
e Across all countries, the difference in average civic knowledge scale scores between female 


and male students was equivalent to roughly one third of a level on the ICCS scale. (Table 
IPS) 


Socioeconomic status (SES), denoted by parental occupation, parental education, and number 
of books in the home, was significantly positively associated with student civic knowledge. 


e |nall countries, students in the high SES groups scored significantly higher than those in 
the lower SES groups on the civic knowledge scale. (Table 3.14) 
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Immigrant background and language background were associated with student civic 

knowledge. (Table 3.15) 

e In 140f 21 countries, students from immigrant families had statistically significantly lower 
civic knowledge scores than students from non-immigrant families. 

e |n 17 of 21 countries, students who reported mainly speaking the language of the ICCS 
test at home had statistically significantly higher civic knowledge scale scores than those 
who reported speaking another language at home. 
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The ICCStest of civic knowledge covered the four content and two cognitive domains described 
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STUDENTS CIVIC KNOWLEDGE 


The proficiency levels represent a hierarchy of civic knowledge in terms of increasing soph 


istication 


of content knowledge and cognitive process. Increasing levels on the scale typically represent 
increasingly complex content and cognitive processes as they are demonstrated through student 
performance. However, it is important to note that all levels of this scale can include content related 
to both cognitive domains (knowing as well as reasoning and applying), and that the progression is 
not simply an extension from simple content knowledge at the bottom to reasoning and application 


atthe top. The sophistication of demonstrable achievement assessed in any given item i 


that content. 


thatcivic knowledge becomes more sophisticated as student achievement progresses up 


s aresult 


of the interaction between the civic and citizenship content and the cognitive process applied to 


The scale broadly reflects hypothesized development from the concrete, familiar, and more 
mechanistic elements of civics and citizenship through to the wider policy and institutional 
processes that determine the shape of our civic communities. The scale is hierarchical in the sense 


the scale. 


Although the scale does not describe a necessary sequence of learning, it does postulate that 


learning growth typically follows the sequence described by the scale. We constructed 
according to the assumption that any given student can demonstrate achievement of 
contents below his or her measured level of achievement. 


Extending the scale in ICCS 2016 
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Figure 3.1: ICCS civic knowledge scale with examples 
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Table 3.1: Sample item 1 with percentage correct by country 
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Everyone has the right to education. Education shall be free... 
and compulsory. 


The Universal Declaration of Human Rights 


ICCS civic knowledge scale: Below Level D 


Why is education considered a human right? 


* Because children enjoy going to school and spending time with 
their friends. 


* Because education provides jobs for lots of teachers. 

Because children can be in school while 

working. 

* Because education develops the skills people need to participate 
in their communities” 


heir parents are 


Notes: 


( 


+ 


1 


) 
(9) 


Correct response. 

Standard errors appear in parentheses. 

Country deviated from International Defined Population 
and surveyed adjacent upper grade. 

Met guidelines for sampling participation rates only after 
replacement schools were included. 

National Defined Population covers 9096 to 95% of National 
Target Population. 

Country surveyed target grade in the first half of the school 
year. 

No comparable data available. 


Country Percentage correct response 
Belgium (Flemish) 95 (0.8) 
Bulgaria 88 (1.6) 
Chile 86 (1.1) 
Chinese Taipei 95 (0.6) 
Colombia 92 (08) 
Croatia e OT) 
Denmark! 96 (0.5) 
Dominican Republic 68 (18) 
Estonia! 98 (0.4) 
Finland em (OS) 
taly 96 (0.6) 
Latvia? 91 (1) 
Lithuania 97 (0.5) 
alta 87 (0.9) 
exico 88 (1.1) 
etherlands! 96 (1.0) 
orway (9)! 95 (0.5) 
Peru 91 (08) 
Russian Federation 95 (0.9) 
Slovenia 94 (08) 
Sweden! 95 (0.6) 
ICCS 2016 average 92 (0.2) 
Countries not meeting sample participation requirements 
Hong Kong SAR 84 (1.8) 
Korea, Republic of? Cor ED 
Benchmarking participant not meeting sample participation 
requirements 
North Rhine-Westphalia (Germany)! - - 


examples process of cognitive domain 1 (knowing) of the ICCS assessment framework. On average 
across all countries, 92 percent of students achieved full credit on this item. The percentages across 
countries ranged from 68 to 98 percent. 


Sample items 2 and 3: Level D 


Sample items 2 and 3 are located in Level D onthe ICCS civic knowledge scale. Sample item 2 (Table 


edt 
toa 


KS 


required students to recognize, through an example, the principle that the law applies equally 
people. This principle is a fundamental aspect of the rule of 


aw and is a foundational aspect 


for further learning and higher-order thinking in the civic and citizenship domain. Sample item 2 
relates to the rule of law sub-domain of content domain 2 (civic principles) and to the illustrate with 
examples process of cognitive domain 1 (knowing). On average across all countries, 89 percent of 
students, on average, achieved full credit on this item. The percentages across countries ranged 


from 64 to 97 percent. 


STUDENTS CIVIC KNOWLEDGE 


Table 3.2: Sample item 2 with percentage correct by country 
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Country Percentage correct response 
A government minister in <Exland> has been caught speeding Belgium (Flemish) 95 (0.7) 
in his car. He received a fine for breaking the road laws. Bulgaria 82 (16 
Chile 83 (08 
ICCS civic knowledge scale: Level D Chinese Taipei 91 (08 
Why does the minister have to pay the fine? Colombia 88 (1.0) 
* Because ministers have enough money to pay the fines. Croatia OON OA 
* The law treats everyone as equal. 
d i d — Denmark! 96 (04) 
* Because he wants people to vote for him again. — : 
* Because the police can arrest him if he fails to pay the fine. Dominican Republic 64 (15 
Estonia? 95 (08 
Finland 97 (0.5 
taly 96 (0.7 
Latvia! 88 (13 
Lithuania 92 (1.0 
alta SOROS 
exico 79 (1.1) 
etherlands' rs} (HL 
orway (9)1 93 (0.5) 
Peru Some OM, 
Russian Federation 92 (1.0) 
Slovenia ZORRO 
Notes: Sweden‘ 93 (07 
* Correct response. ICCS 2016 average 89 (0.2) 
() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population Countries not meeting sample participation requirements 
and surveyed adjacent upper grade. Hong Kong SAR 88 (14) 
T Met guidelines for sampling participation rates only after Korea, Republic of? 95 (08) 
replacement schools were included. 
1 National Defined Population covers 9096 to 9596 of National Benchmarking participant not meeting sample participation 
Target Population. requirements 
? Country surveyed target grade in the first half of the school q = : 
year. North Rhine-Westphalia (Germany) 95 (12) 


Sample item 3 (Table 3.3) required students to recognize the capacity of governments to use 
workplace laws as a means of protecting workers' wellbeing. Students evaluated the relative 
feasibility of a set of possible government interventions presented within t 
understanding of the role of government in democratic societies. The item relates to the state 


institutions sub-domain of content domain 1 (civic society and 


in cognitive domain 2 (reasoning and analyzing) of the ICCS assessment 
to evaluate alternative actions set within a familiar and explicit civic and citizenship context is a 


foundational aspect of civic knowledge. On average across al 


achieved full credit on this item. The percentages across countries ranged 


systems) an 


he context of students' 


d the evaluate process 


framework. The ability 


countries, 85 percent of students 


from 60 to 95 percent. 
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Table 3.3: Sample item 3 with percentage correct by country 


BECOMING CITIZENS INA CHANGING WORLD 


* 


( 


t 


1 


N 


Country Percentage correct response 
Many people in noisy workplaces in <Exland> have had their Belgium (Flemish) 87 (12 
hearing damaged by the noise. Bulgaria 86 id 
Chile 80 (11 
Chinese Taipei VL (ole 
ICCS civic knowledge scale: Level D Colombia 86 1 
What is the most reasonable action the government could take to z 
deal with the problem of noisy workplaces? Croatia ?1 11 
* Immediately close down all noisy workplaces Denmark! 88 (0.9) 
* Give money to the workers to help them find jobs in quieter Dominican Republic 60 1.5 
workplaces w 
e Introduce laws stating that employers must protect workers Estonia 90 10 
from noise* Finland 95 (0.8 
* Arrest all owners of noisy workplaces taly 80 13 
Latvia? AL sil 
Lithuania 88 (12 
alta St GES 
exico 84 (11 
etherlands! e (Le 
orway (9)1 92 (0.7) 
Peru ee (AS 
Russian Federation 91 (0.8) 
Slovenia AO EO) 
T 

Notes: Sweden 90 (144) 
Correct response. ICCS 2016 average 85 (0.2) 

) Standard errors appear in parentheses. 

(9) Country deviated from International Defined Population Countries not meeting sample participation requirements 
and surveyed adjacent upper grade. Hong Kong SAR 85 (1.6) 
Met guidelines for sampling participation rates only after Korea, Republic of? 81 (14) 
replacement schools were included. : : 
National Defined Population covers 9096 to 95% of National Benchmarking participant not meeting sample participation 
Target Population. requirements 
Country surveyed target grade in the first half of the school : - 
year. North Rhine-Westphalia (Germany)! 93 (1.0) 


Sample item 4: Level C 


Sample item 4 (Table 3.4) required students to associate the need for accuracy of information with 


journalists' indepe 
freedom individua 


ndence from external control. Because the focus of the item is on the extent of 
s have to collect and report information, the item relates to the freedom sub- 


domain of content domain 2 (principles) and the generalize process in cognitive domain 2 (reasoning 
andanalyzing) of the ICCS assessment framework. Sample item 4 thus illustrates a broad familiarity 


with the concept o 
credit on this item 


f freedom. On average across all countries, 75 percent of students achieved full 
. [he percentages across countries ranged from 56 to 87 percent. 
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Table 3.4: Sample item 4 with percentage correct by country 
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Country Percentage correct response 
ICCS civic knowledge scale: Level C Belgium (Flemish) 77 (13) 
Why is it important that journalists are freely able to research and Bulgaria 78 (1.6) 
report the news? - 
e It builds trust in the country's government. Chile 66 (13) 
* |thelps journalists to provide accurate information to the public* Chinese Taipei ler) 
D e that there are enough journalists to report all news Colombia 66 (14) 
e |t makes sure that no individual journalist is paid too much Croatia 87 (10) 
money for their work. Denmark! 78 (1.1) 
Dominican Republic Sio. DEEN 
Estonia! 79 (1.5) 
Finland ieu by 
taly 84 (1.1) 
Latvia! Lo LS 
Lithuania 71 (1.4) 
alta TAL ESY 
exico 61 (1.5) 
etherlandst 66 (1.6) 
orway (9)1 79 (1.0) 
Peru OP (124) 
Russian Federation 81 (1.5) 
Slovenia GNE 
Notes: Sweden: 77 (1.7) 
Correct response. ICCS 2016 average 75 (0.3) 
() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population and Countries not meeting sample participation requirements 
surveyed adjacent upper grade. NM Hong Kong SAR 76 (1.6) 
T Met guidelines for sampling participation rates only after Korea, Republic of? 78 (15) 
replacement schools were included. 
1 National Defined Population covers 9096 to 95% of National Benchmarking participant not meeting sample participation 
Target Population. rr 
? Country surveyed target grade in the first half of the school q = : 
year. North Rhine-Westphalia (Germany) TE RIES) 


Sample item 5: Level B 


Sample item 5 (Table 3.5) required students to recognize a justification for voting from an implicit 


democratic perspective. While achievement at the lower levels of the 
reflects explicit representations of democracy and democratic proces 


proficiency scale 


s, sample item 5 is an 


example of achievement at Level B because students needed to recognize and apply democratic 


principles to a decision-making context despite democracy not being exp 
item. The item relates to the decision-making sub-domain of content doma 


icitly 


in3 (ci 


and to the illustrate with examples process of cognitive domain 1 (knowing) of the 


framework. On average across all countries, 59 percent of students achi 
item. The percentages across countries ranged from 21 to 82 percent. 


eved 


mentioned in the 
vic participation) 
CCS assessment 
full credit on this 
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Table 3.5: Sample item 5 with percentage correct by country 


BECOMING CITIZENS IN ACHANGING WORLD 


Country Percentage correct response 
Belgium (Flemish) 71 (2.0) 
Bulgaria ONES) 
Chile 50 (1.1) 
Members of a youth club want to choose a leader. One = — 
member offers to be the leader, but club members decide to Chinese Taipei 58 (13) 
vote to elect a leader. Colombia 35 (4.0) 
Croatia Seo Lio) 
ICCS civic knowledge scale: Level B Denmark! 80 (12) 
What is the best reason for the club to elect the leader by a vote Dominican Republic PL (GIGS) 
rather than choosing a person who offers to be the leader? T m 
e : I : Estonia 63 (17) 
* Voting enables people to hold a second vote if they disagree with — 
the outcome. Finland e Ges) 
* Voting is the fastest way to decide who should be the leader. taly 66 (14) 
* Voting enables every member of the club to participate in "EET 
choosing the leader? Latvia eS (1) 
* Voting ensures that every member of the club will be happy with Lithuania 47 (1.6) 
the choice of leader. ala 60 (1.5) 
exico 30 (1.4) 
etherlands! ou. (20) 
orway (9)! 65 (13) 
Peru 49 (14) 
Russian Federation 68 (144) 
Slovenia Hit o) 
Notes: Sweden! 68 (1.9) 
Correct response. ICCS 2016 average 59 (0.3) 
() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population and Countries not meeting sample participation requirements 
surveyed adjacent upper grade. mE Hong Kong SAR 56 (18) 
+ Met guidelines for sampling participation rates only after Korea, Republic of? 54 (14) 
replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Benchmarking participant not meeting sample participation 
Target Population. requirements 
? Country surveyed target grade in the first half of the school q : : 
year. North Rhine-Westphalia (Germany) 66 (2.4) 


Sample items 6, 7, and 8: Levels C, 


Sample items 6 and 7 (shown in Tab 
Samplei 
to the concept of power 
The item is an example o 
needed 
aw sub-dom 
of cognitive 
percent of s 
from 41 to 8 


misuse an 


domain 1 of the ICCS 
tudents achi 
9 percent. 


Sample item 7, a constructed-res 
summary of the scoring guide for 
nine constructed-response items. 
these items. ICCS ensured that alls 


f achievement at Leve 
to recognize an explicit example o 
ain of content domain 2 (civic pri 


eved full credit o 


B,and A 
le 3.6)form 


tem 6 (shownin the unshaded section of Table 3.6) provided students with an intro 


d then requ 


E 


assessmen 


misuse of power. 


aunit dealing with the concept of misuse of power. 
duction 
ired them to recognize an example of that misuse. 
C on the ICCS proficiency scale because students 
Example item ó relates to the rule of 
ples) and to the illustrate with examples process 


ramework. On average across all countries, 73 


nci 
tf 


n thi 


s item. The percentages across countries ranged 


ponse item 


for ICCS as part of the centralized i 


nternationa 


responsible for scorer training and scoring wi 


the item. Th 
Expert scorers in each country scored students' responses to 
corers were trained to the international standards established 


, appears again in Table 3.7, but this time with a 
e ICCS civic knowledge test instrument included 


scorer training program that ICCS ran for experts 
thin each country.! The scoring guide allowed for 


1 Twodifferent scorers independently scored about 100 booklets per country in order to assess the inter-rater agreement 


per booklet. The only data included in the 
at least 60 percent. 


analysis were 


hose from constructed items with an inter-rater agreement of 


STUDENTS CIVIC KNOWLEDGE 


Table 3.6: Sample items 6 (unshaded) and 7 (shaded) with percentage correct by country for sample item ó 


Misuse of power is when a person who holds a position of 
authority uses their power unfairly or improperly. 


ICCS civic knowledge scale: Level C 


Which of the following examples best shows misuse of power? 
e A political leader speaks out in the media against a proposed law. 


* Apolitical leader employs people only if they have donated 
money to her party: 


* Apolice officer arrests someone who has broken the law. 
* Agroup of environmental activists organizes a protest outside 


the «parliament». 


In a democracy, what can be done to prevent political leaders 


misusing their power? 


Write two different things that can be done. 


il 


2 


Notes: 


* 


() 


(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 


al 
2 


the al 
respo 


Correct response. 


Standard errors appear in parentheses. 
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Country Percentage correct response 
Belgium (Flemish) 77 (19 
Bulgaria 68 (23 
Chile 73 (13 
Chinese Taipei Ver) 
Colombia 72 (15 
Croatia S (al 
Denmark! 84 (10 
Dominican Republic 41 (1.8) 
Estonia! 81 (1.5 
Finland She) (ao) 
taly 68 (1.5 
Latvia! 7/21 (ls 
Lithuania 76 (1.3) 
alta (Gu (Ly 
exico 73. (15 
etherlands! o y 
orway (9)! 78 (0.9 
Peru 5i 4 
Russian Federation 75 (14) 
Slovenia 68 (1.6 
Sweden! 77 (12 
ICCS 2016 average 7) {(0)83) 
Countries not meeting sample participation requirements 
Hong Kong SAR 75 (1.9) 
Korea, Republic of? 80 (1.4) 
Benchmarking participant not meeting sample participation 
requirements 
North Rhine-Westphalia (Germany) Ta MIRO 


National Defined Population covers 9096 to 9596 of National Target Population. 


Country surveyed ta 


ocation of O( 
nse items. Ta 


rget grade in the first ha 


no credit), 1 (partia 


f of the school year. 


credit), or 2 (full credit) for seven of the nine constructed- 
ble 3.7 shows the percentages of students who achieved partial credit and 


full credit. The full credit response (two points) is located in Proficiency Level A of the ICCS civic 


know 


edge scale, a 


Level B of the scale. 


Sample item 7 relates to the legislatures/parliaments sub-domain. It also relates to t 
power/autho 
inthefirst cognitive do 


rity of the í 


nd the partial cred 


main (knowing 


it (one point) response category is located 


in Proficiency 


he concept of 


first content domain (civic society and systems) and to the describe process 
of the |CCS assessment framework. One of the advantages 


of including the constructed-response item format in some of the ICCS items was that it provided 


ample item 7 has eight d 
ble to generate responses meeting t 
wo score points) on thi 
ivic knowledge scale. Stud 


tudents with opportunity 
ivic concepts. 


to demons 


ifferent ca 


trate knowledge and understanding relating to multifaceted 


tegories of response worthy of credit. Students who were 
he standards in any two categories were awarded full credit 
sitem, thus positioning their responses at Proficiency Level Aon the ICCS 
ents who could provide only one response deemed worthy of a credit 
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Table 3.7: Sample item 7 with summary scoring guide and percentage correct by country 


BECOMING CITIZENS IN A CHANGING WORLD 


Country Percentage at Percentage 
In a democracy, what can be done to prevent political leaders least 1 point 2 points only 
misusing their power? Belgium (Flemish) 82 (17) 39 (17 
Write two different things that can be done. Bulgaria 55 (2.1) TOR CES 
* Chile 48 (14) 13 (08 
2 Chinese Taipei 86 (1.4) 577 — te) 
Colombia 71 (14) 29 (12 
Scoring Guide Croatia Sle Ges) S7 pa 
Code2 Denmark | 79 (1) 38 (1.5 
ICCS civic knowledge scale: Level A Dominican Republic - - 
Refers to methods/mechanisms from two different categories of Estonia? 56 (1.6) 19 (14 
the categories listed below. Stader 68 (16) DNE 
1. Separation of powers/laws that limit what people in positions of : — 
authority can do/checks and balances on process. taly 60 (1.5) 19 (11 
2. Rule of law/laws enforced against political leaders. Latvia! oil (20) Je C2 
3. Transparency (e.g. an independent press/freedom of the press/ ithuania 55 (2.2) 20 (17) 
reedom of information. = ` ` 
4. Freedom of speech/allowing criticism of the actions of political alta AL fan) H (Or) 
eaders. exico 70 (1.2) 28 (12) 
5. Theright to take political action (e.g. public protest, formation of 
pressure groups). etherlands! Te, DEE ee (2.4) 
6. Elections (people can choose not to vote for a party that is seen orway (9)! 69 (12) 23 (10) 
misusing power). She 47 (15) 14 (10) 
7. Education for public. n n 
8. Education for political leaders including providing advice (may Russian Federation 79 (15) 35 (19) 
include modelling by other leaders). Slovenia e b 29s T7) 
Code 1 Sweden! 76 (14) 37 (1.5) 
ICCS civic knowledge scale: Level A ICCS 2016 average 66 (0.4) 27 (0.3) 
Refers only to methods/mechanisms from one of the listed " S BE " 
categories (including responses in which different methods/ Countries not meeting sample participation requirements 
mechanisms from the same category are provided. Hong Kong SAR 67 (2.8) 22 (1.6) 
Korea, Republic of? 78 (14) eo ` (Qui 


Benchmarking participant not meeting sample participation 


requirements 


North Rhine-Westphalia 
(Germany)! 


(oy (222) 


208 (23) 


Notes: 


0 
(9) 
t 


Correct response. 

Standard errors appear in parentheses. 

Country deviated from International Defined Population and surveyed adjacent upper grade. 
Met guidelines for sampling participation rates only after replacement schools were included. 
National Defined Population covers 90% to 95% of National Target Population. 

Country surveyed target grade in the first half of the school year. 

No comparable data available. 


response were awarded partial credit (one score point), thus locating their response at Proficiency 


Level B on the scale. 


io) 


across countries ranged from 11 to 57 percent. 


The introductory stimulus presented in the first part of the unit (see sample item 6 in Table 3.6) 
provided students with a working definition of the misuse of power. In sample item 7, students 
able to provide more than one credit-worthy response demonstrated knowledge of at least two 
different ways of preventing misuse of power. The rationale behind interpreting responses to this 
item is that knowledge of more than one facet of a multifaceted concept is necessary to formulate 
ffective arguments based on different perspectives on the issue. While the item itself does not 
require students to formulate acomplex argument, it does require them to demonstrate the capacity 
to identify aspects of the content necessary for building a complex argument. On average across 
all countries, 27 percent of students were able to achieve full credit on this item. The percentages 


STUDENTS CIVIC KNOWLEDGE 


Students achieving partial credi 
categories listed in 


tonsample item 7 were ableto identify any one of the eight different 
the scoring guide. Because partial credit denotes students' awareness of this 


concept from a single perspective, it is indicative of a Level B standard of proficiency on the ICCS 


civic knowledge sca 


e. Onaverage across all countries, 66 percent of studen 


atleast partial credit on this item. The range of percentages across all countrie 


Sample item 8 (Table 3.8), a multiple-choice item, required students to ide 


pol 


fra 


Table 3.8: Sample item 8 with percentage correct by country 


requiring the disclosure of donors' identities. This 
scale, is an example of students making connections between a poli 
ates to the rule of law sub-domain of con 
and the evaluate process in cognitive domain 2 (reasoning and analyzing) o 
mework. On average across all countries, 43 percent of studen 
item. The percentages across countries ranged from 20 to 83 percent. 


to regulate it. The item re 


itical parties to show they are not unduly 


ntify that 


ts were able to achieve 
swas 41 to 86 percent. 


the need for 


influenced by donors can provide justification for laws 
item, located at Level Ao 
tical process andt 
tent domain 2 (civi 
f the ICCS assessment 
ts correctly responded to this 


nthe ICCS proficiency 


he laws used 
c principles) 
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Individuals or groups sometimes give money to political 
parties as donations. Some countries have laws that require 
political parties to give the public access to information about 
donations to parties. 


ICCS civic knowledge scale: Level A 


Why do countries have these laws? 


The laws encourage people to vote for the political parties that 
receive fewer donations. 

The laws help the public to decide which party is likely to win the 
next election. 

The laws encourage more people to join the wealthy political 
parties. 

The laws discourage political parties from favoring the people 
who make the donations." 


Notes: 


() 
(9) 


" 


1 


Correct response. 

Standard errors appear in parentheses. 

Country deviated from International Defined Population 
and surveyed adjacent upper grade. 

Met guidelines for sampling participation rates only after 
replacement schools were included. 

National Defined Population covers 9096 to 9596 of National 
Target Population. 

Country surveyed target grade in the first half of the school 
year. 

No comparable data available. 


Country Percentage correct response 
Belgium (Flemish) 36 (2.1 
Bulgaria 38 (20 
Chile 34 (12 
Chinese Taipei 83 IO 
Colombia 37 (13 
Croatia 46 (17 
Denmark! 62 4 
Dominican Republic 27 4 
Estonia! 50 (17 
Finland S9. qs 
taly 20 (1.1) 
Latvia! 28 4 
Lithuania 41 (18 
alta 42 4 
exico 25 (13) 
etherlands! 40 (1.8 
orway (9)* 68 (10 
Peru 24 (12 
Russian Federation 47 (19 
Slovenia 43 (1.5 
Sweden? 50 (15 
ICCS 2016 average 43 (0.3) 
Countries not meeting sample participation requirements 
Hong Kong SAR 67 (24) 
Korea, Republic of? - 
Benchmarking participant not meeting sample participation 
requirements 
North Rhine-Westphalia (Germany)! Si qi 
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BECOMING CITIZENS IN A CHANGING WORLD 


Each of the example items was located at those points on the ICCS civic kno 
a student had a 62 percent chance of answering the item correctly (Figure 3.2)? For example, 
a student with a measured ability of 443 scale points would have had a 62 


of correctly answering sample item 4. The same student would have had 


probability of correctly answering sample items 5, 6, 7 (for 
than 62 percent probability of correctly answering samp 


If a student attains a measured proficiency within a given 
we can be confident that he or she would have correctly an 


partial or full credit) 
le items 1, 2, and 3. 


wledge scale where 


percent probability 


aless than 62 percent 


,and 8, and a greater 


level on the ICCS civic knowledge scale, 
swered at least half of the items spanning 


the level.? As a consequence, we can assume that the description of achievement for any given 


level is broadly applicable to any student with a measured proficiency wi 


of where the student's proficiency is located within that 


Thecivic knowledge scale recognizes the relative difficu 


evel. 


processes they are intended to represent (Figure 3.2). I 


ied) 


Comparison of civic knowledge across cou 
Average civic knowledge scores across countries 


The average score on the reporting scale developed at 
and the standard deviation at 100. This score and its sta 


participating countries through the use of equally weighted na 


tems assessing stud 


ntries 


thin the level, regardless 


ty of items and the content and cognitive 


ents’ reasoning and 


nalytical abilities are not necessarily more difficult than those that assess knowing. Question 
difficulty results from a combination of two factors: (i) how familiar a student 
inherent in that question, and (ii) the type of cognitive processing that the stud 
in to correctly answer the question. As is evident from Figure 3.2, relatively simple processing of 
complex content can be similar to the proficiency needed for complex processin 


is with the concepts 
ent needs to engage 


g of familiar content. 


the time of ICCS 2009 was set at 500 
ndard deviation were established for all 
tional samples. The average score 


of the ICCS 2016 countries was 517 scale points (readers should note the differences in the 


composition of the group of countries participating across both surveys), and th 
was 101 scale points for all country data with equally wei 


In ICCS 2016 the average country scores on the civic 
ranged from 467 to 586 scale points (approximately 1.2 


the national averages of two countries, Peru (438 scale points) and the Domi 
scale points), were substantially below 467 scale points (Table 3.9). The di 
also varied across countries. This pattern can be seen graphically in Ta 


ghted national sam 


nowledge scale of 
international stand 


estandard deviation 
ples. 


19 of 21 countries 
ard deviations), and 
nican Republic (381 
stribution of scores 


ble 3.9, where the length 


of the bars shows the distribution of student scores for each country. The spread appeared to be 


unrelated to the average scale score across countries. 


Nineteen countries recorded average scale scores statistical 
2016 average of 517 scale points. The two exceptions were Lithu 


y significantly different from the ICCS 
ania and the Netherlands. Eight 


countries had national averages that were significantly below the ICCS 2016 average; 11 countries 


had national averages that were significantly higher. The 


difference between 


the bottom quartile 


and the top quartile (that is, the area covering the middle half of the averages for countries) was 


61 scale points. 


2 Scaledescriptions were developed using a response probability of 0.62, while initial item calibration assumed a response 
probability of 0.5. See the ICCS 2016 technical report for more detailed information (Schulz et al. forthcoming). 
3 This is a result of a combination of the response probability of 0.62 established for reporting student achievement and 


the level width of 84 scale points. 
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Figure 3.2: Location of example items on the civic knowledge scale 


Sample Item 7 (Code 2) 
(CCS scale: 670 pts. 
Content domain: 1. 
Cognitive domain: 1 


Lists two ways of preventing the 
misuse of power in a democracy 


Sample Item 5 

ICCS scale: 524 pts. 

Content domain: 3 

Cognitive domain: 1 

Integrates the process of voting to 
the principle of equality through 
representation of views 


Sample Item 6 
ICCS scale: 451 pts. 
Content domain: 2 
Cognitive domain: 1 


Recognizes an example of the 
misuse of power 


Sample Item 2 
ICCS scale: 322 pts. 
Content domain: 2 
Cognitive domain: 1 


Recognizes that all people are 
equal before the law 


395 


311 


Level C 


Level D 


Below Level D 
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Sample Item 8 
(CCS scale: 605 pts. 
Content domain: 2 
Cognitive domain: 2 


Relates the responsibility for 
fair and equal governance 
to laws regarding financial 
donations to political parties 


Sample Item 7 (Code 1) 
ICCS scale: 509 pts. 
Content domain: 1 
Cognitive domain: 1 


Lists one way of preventing the 
misuse of power in a democracy 


Sample Item 4 
ICCS scale: 443 pts. 
Content domain: 3 
Cognitive domain: 2 


Relates freedom of the press to 
the right of the public to receive 
accurate information from the 
media 


Sample Item 3 
(CCS scale: 363 pts. 
Content domain: 1 
Cognitive domain: 2 


Recognizes that governments 
can create laws to help protect 
worker safety 


Sample Item 1 
(CCS scale: 284 pts. 
Content domain: 2 
Cognitive domain: 1 


Recognizes why education is a 
human right 
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Table 3.9: Distributions of civic knowledge 


Civic knowledge 
Country Yearsof Average Average scale HDI 
schooling age 250 350 450 550 650 750 score 
Denmark! 8 14.9 x | E NN 586 (30 A | 0.93 
Chinese Taipei 8 4.1 SR 581 (30 A | O88? 
Sweden! 8 4.7 | — 1| 579 (28 A | 091 
Finland 8 48 || i ccc 577 (23) A | 090 
orway (9): 9 4.6 ! | aS 564 (2.2) A | 0.95 
Estonia! 8 49 : | Pen 546 (31 A | 087 
Russian Federation 8 4.8 TE 545 (4.2) A | 0.80 
Belgium (Flemish) 8 13.9 ' (eeng 537 (41 A | 090 
Slovenia 8 138 lee 532 (25) A | 089 
Croatia 8 4.6 ! ! a 531 (25) A | 083 
taly 8 13.8 | : egen 524 (24) A | O89 
etherlands! 8 14.0 ! š LM Eve TALES) 0.92 
Lithuania 8 47 ' "Rm 518 (30) 0.85 
Latvia! 8 48 | -—— —À 492 (31) v | 083 
alta 9 13.8 wa ——. 491 (27) Y | 086 
Bulgaria 8 47 à —_— 485 (53) Y | 079 
Chile 8 4.2 —— 8 j| 482 (3.1) V | O85 
Colombia 8 4.6 ' ` manaa Se 482 (34) Y | 073 
exico 8 41 C E — | 467 (25) Y | 076 
Peru 8 40 Eum 5; — m 438 (3.5) w | 074 
Dominican Republic 8 42 L— — ee | 381 (30) Y | 072 
ICCS 2016 average 14.4 Below D D (e B A 547507) 
Proficiency Leve 
Countries not meeting sample participation requirements 
Hong Kong SAR 8 13.9 Tm 515 (6.6) 0.92 
Korea, Republic of? 8 140 ——<— 551 (36) 0.90 
Benchmarking participant not meeting sample participation requirements ! , 
North Rhine-Westphalia 8 14.3 ' i H h TOM 0.93 
(Germany)! i — | 
Percentiles of performance — A Achievement significantly higher 
5th 25th 75th 95th than international average 
W Achievement significantly lower 


T 


Average and Confidence Interval (+2SE) than international average 


Notes: 

() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 

2 Country surveyed target grade in the first half of the school year. 

3 Data estimated for 2014. Source: http://focustaiwan.tw/news/asoc/201409180039.aspx. 


We observed considerable variation in students’ civic knowledge scores within countries. Across 
countries, the median variation between the bottom five percent and the top 95 percent of civic 
knowledge scores was 275 scale points, equivalent to a span of more than three levels on the |CCS 
civic knowledge scale. The pairwise comparisons of country achievement in Appendix Table E.1 
indicate significant differences in civic knowledge between individual countries. 
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Average civic knowledge scores across countries 


Ta 


ble 3.9 also shows t 


he percentages of students at each proficiency level of the civic knowledge 


scale for each country. We have presented the countries in descending order according to the 
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ngorder of average score. 
tions of students across the levels that exist within the countries with 


Differences in country rankings are a result 


similar average student civic knowledge scores. 


On average across all participating countries, two thirds of students achieved scores that 
them within Levels A and B of the ICCS civic knowledge proficiency scale (Table 3.10). Af 
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res at Levels A and B. In two countries, the relatively 
ce were found at Level C. Only one country had the 
ttaining test scores corresponding to Level D. In two 
n Republic—more than 60 percent of students were at 


Variations across countries with respect to associations between civic knowledge, Human 
Development Index, and student age 
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y because average student age across countries relates to local conditions (e.g., the age at 
children begin school) and to student retention and progression rates, factors that may, in 
DI. Across countries, student age showed a weak positive association 
vic knowledge (r = 0.33). We found no association between average student age and H 


Index (H 
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d having a decent standard of living" (UNDP, 2016). 
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average civic knowledge scale scores emerged across the 
0.82,* p = 0.78)? Of the 11 countries with average civic 
ificantly above the ICCS 2016 international average of 


with values above 0.9, and eight had very high HDI, with 
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Table 3.9). At first 
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at the country level (r = 0.02). 


han the pattern of association with HDI. This difference 
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4 Pearson correlation coefficient between average country civic knowledge scale scores and HDI. 
5 Spearman's rank correlation between the ranks of average country civic knowledge scale scores and ranks of country HDI. 
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Figure 3.3: Scatterplot of average civic knowledge scale scores and Human Development Index (HDI) values 
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Changes in civic knowledge since 2009 
ThelCCS 2016 test included 42 secure items from ICCS 2009. This inclusion meant that we could 


report student civic knowledge scores 


for the current [CCS cycle on the scale established in 2009, 


and also compare changes in civic knowledge across these first two cycles of ICCS. Twenty-one 
of the countries that participated in ICCS 200? also conducted the ICCS 2016 survey. Eighteen 


of these countries met the necessary 


comparisons of studen 


Most countries record 


ed an increase in civic knowledge between 2009 an 


technical requirements within each cycle to allow reliable 
ts’ civic knowledge across the two cycles.^ 


d 2016 (Table 3.11). 


Eleven of the 18 countries with comparable data recorded ICCS 2016 national average civic 


knowledge scale score 


s sign 


The score point-differences 


We found no statistica 
countries. 


The key differences be 
onthecivic knowledge 


tween 


scale 


the interconnectedness of c 
and intended outcomes. This distinction needs to be kept in mind with regard to Table 3.12, which 
shows the changes in the proportions of students at Level B and above on the ICCS civic knowledge 
proficiency scale between 2009 and 2016. 


varied from 13 scale poin 


ly significant score changes be 


are the specificity of stud 
ivic and civil institutions, 


ficantly higher than the corresponding scores 


ts in Lithuania to 42 sc 


in the previous cycle. 


ale points in Sweden. 


tween the two cycles in the remaining seven 


achievement at Level C and below in comparison to Level B and above 
ents’ knowledge and their understanding of 
including those between policies, practices, 


Consistent with the scale score increases (refer Table 3.11), the percentages of students at Level 
B and above increased markedly between 2009 and 2016 (Table 3.12). In 14 of the 18 countries 
with comparable data, the increases were statistically significant. The increases varied from three 


percent in Denmark to 18 percent in the Russian Federa 
differences in the percentages of students at Level B an 


not statistically significant. 


tion. In the remaining four countries, the 
d above between 2009 and 2016 were 


6 The ICCS 2009 and 2016 technical requirements relating to sampling, instrument preparation and field operations are 
included in the ICCS Technical Reports (Schulz, et al., 2010 and Schulz et al., forthcoming). 
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Table 3.11: Changes in average civic knowledge between 2009 and 2016 


Average scale Average scale Difference Differences 2016-2009 
Country score score (2016-2019) 
ICCS 2016 ICCS 2009 S0 =Q 0-309-200-1009 0) 10) 20°30) 40) 50 

Sweden? 579 (2.8) 537 (3.1) 42 (5.2) Saal 
Russian Federation 545 A3) 506 (3.8 38 (6.5) [ems nmm] 

orway (9)! 564 (22) 538 (40 25 (5.5) [iam 
Belgium (Flemish) Sew (db) 514 (47 23 (6:9) wasps 
Chinese Taipei 581 (30) 559 (24) 22 (50) Essen 
Estonia! 546 (3.1) 525 (45 21999 (6:9) aay 
Colombia 482 (34) 462 (2.9) 20 (5.5) 2009 aay 2016 
SERE 485 (53) 466 (50 19 (80) MEN -—- `" 
Slovenia 582 (2.5) 516 (27 16 (48) Sa 

exico 467 (2.5) 452 (28 15 (4.9) Been 
Lithuania 518 (3.0) 505 (2.8 13 (52) =a 
Latvia! a (Gall) 482 (4.0 ital o) 
Denmark! 586 (3.0) 576 (3.6 10 (5.6) 

alta ZO 2) 490 (4.5 2.1) ll 
Dominican Republic 381 (3.0) 380 (24 (5.0) 
Finland S o9) 57602: Ones) 
Chile 482 (3.1) 483 (3.5 -1 (5.6) 
taly 524 (22) Sell (eh) SONS) 
Notes: Wi Difference statistically significant at 0.05 level 
() Standard errors appear in parentheses. Difference not statistically significant 


Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
t Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 


Variations in civic knowledge across countries with respect to student 
background characteristics 


In this section we address ICCS Research Question 2(a): Are there variations in civic knowledge 
associated with student characteristics and background variables? (See Chapter 1.) Our focus at this 
point is therefore on the associations between students' civic knowledge and student gender, 
student age within countries, variables associated with students' socioeconomic status, whether 
or not students had an immigrant background, and the language students spoke at home. Chapter 
7 documents further investigation, based on regression modelling, of the relationships between 
student civic knowledge and student-level and school-level factors. 


Gender differences in civic knowledge 


A significant gender difference in civic knowledge was apparent for only one of the 28 countries 
that took part in the IEA CIVED study (Torney-Purta et al., 2001). In ICCS 2009, “the average ICCS 
civic knowledge scores of female students were higher than those of male students both overall 
and in nearly all countries" (Schulz, Ainley, Fraillon, Kerr & Losito, 2010, p. 80). 


Gender differences in the ICCS 2016 data (Table 3.13) tell a similar story to the one recorded 
in ICCS 2009. In 2016, the average civic knowledge sores of female students was statistically 
significantly higher than that of male students in 19 of 21 countries and overall across countries. The 
two countries where the gender difference was not statistically significant were Peru and Belgium 
(Flemish). The magnitude of the significant differences in the achievement of female students 
relative to male students ranged from nine scale points in Colombia to 38 scale points in Malta. 
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Table 3.12: Changes in percentages of students at or above proficiency Level B between 2009 and 2016 


Country Level B and above Differences 2016-2009 
Difference 
2009 2016 (2016-2019) -20 -10 0 10 20 
Russian Federation 61.6 (1.6) 79.4 (15 18 (24) pum— SS 
Sweden! T CEA Ser GKO 128017 een 
orway (9)1 72.4 (1.6) 823 (08 10 (1.9) [pr 
Colombia 42:7 (1:5) SS 05 10 (2) Reeg 
Estonia! 700 (1.8) 79.9 (12 10 (2.4) Le] 
exico Smo (2) Geet 9. (24) === 
Belgium (Flemish) 678 (2.5) 76.1 (1.8 8 (3.3) 2009 —— | 2016 
Slovenia 664 (14 746 (14 8 (21) M — 
Bulgaria 469 (2.3) 551 (21 8 (32) Reesen 
Latvia! Ss. dps 55517 7 (3.0) E] 
Chinese Taipei 79.8 (1.0) 86.7 (1.0 7 (15) possa] 
Lithuania 63.4 (15 ELi G5 688215) == 
Dominican Republic 81 (07 12.2 (1.0) 4 (14) mami 
Denmark! 83.6 (10 870 (10 St: PS) Rea 
Chile 50.9 (1.9) 53.1 (1.5 2 (27) 
alta 566 (20 SE (uo) 1216) 
Finland 877 (08 874 (08 0 (1.3) D 
taly SE, (eA: Z9 2 x Qu 
Notes: Wl Difference statistically significant at 0.05 level 
() Standard errors appear in parentheses. Difference not statistically significant 


Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 


Student age and civic knowledge within countries 


ICCS 2009 found statistically significant negative associations between student age and civic 
knowledge. Three of the ICCS 2009 countries recorded statistically significant positive associations 
between student age and civic knowledge; no significant association between student age and 
civic knowledge was recorded in two countries (Schulz et al., 2010, p. 76). In order to investigate 
the relationship between student age and civic knowledge in the ICCS 2016 countries, we 
conducted a regression analysis using the ICCS scale score as the outcome variable and student 
age as a predictor (see Table B.1 in Appendix B for the results of the regression analyses). The 
pattern of associations between student age and achievement within countries in 2016 was very 
similar to that reported in ICCS 2009. Fifteen of 21 countries recorded statistically significant 
negative associations between age and civic knowledge. Associations between age and knowledge 
in five of the remaining countries were not significant. However, the last of the 21 countries 
(Norway) recorded a significant positive association. Across the combined international sample, 
the association between student age and civic knowledge within countries was negative and 
statistically significant. 


The high proportion of countries with negative associations between age and achievement is a 
typical outcome of studies that draw grade-based samples of students. In some countries, students 
regarded as having higher academic potential begin school at a younger age and move more quickly 
through the years of schooling than other students. They therefore make up a higher proportion 
of younger students in a given grade level. Variations in retention and progression policies across 
countries also tend to influence within-country associations between age and achievement. 
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Table 3.13: Gender differences in civic knowledge 
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Country Average scale Average scale Difference Gender difference 
score score (absolute value) 
females males <u e L 200 

Malta 511 (37 473 (3.9) 38 (5.4) Been 
Bulgaria S05 (GY) 468 (6.0) 37 5.6 [n ui] 
Sweden! 598 (3.1 562 (3.9) 36 4.3) pamm 
Slovenia 550 (2.6 515 ELN 35 3.4 M 
Chinese Taipei 599 (34 564 (33) 34 3.4 cmm 

orway (9)! 581 (24 547 (2.6) 34 24 Wiss] 
Estonia! 563 (34 530 (3.4) 33 3.6) Eu 
Finland 594 (23 5603A) 33 3.8 ea] 
Latvia! 507 (38 476 (3.7) 30 (42) pem 

ominican Republic 396 (34 oe (uo) 29 3.0 Males seess Een 
Lithuania 532 (3.6 504 (3.4) 28 3.7) ed [er Se 
Croatia 544 (29 Sls E 26 92 pem 
Chile 94 (38 471 (33) 24 3.8) Sa 
Denmark! Soy e Sys) 917A] 23 Ell [caus] 

exico 478 (30 456 (3.2) 21 3.4 es | 
taly Gres. RO Salis; (EHO) 20 3.6 Sa 
Russian Federation 552. (5.1 538 (4.3) 14 4.6) [pem] 

etherlands! 5:910] Go 516 (49) 13 4.0 Ba 
Colombia 486 (4.1 478 (3.6) 3.9) = 
Peru 441 (46 435 (4.1) [o 4.9) 
Belgium (Flemish) 538 (54 537 (4.6) 5.8) 
CCS 2016 average 530 (0.8) 505 (0.8) 25  q(06) E 
Countries not meeting sample participation requirements 
Hong Kong SAR 532 (6.6) 499 (7.7) 33 (69) Sai 

orea, Republic of? 568 (4.8) Sev (elabi 31 (4.6) nm 


Notes: 


( Standard errors appear in parentheses. 
Statistically significant differences (p « 0.05) are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
t Met guidelines for sampling participation rates only after replacement schools were included. 


1 


? Country surveyed target grade in the first half of the school year. 


National Defined Population covers 9096 to 9596 of National Target Population. 


Wl Gender difference statistically significant at 0.05 level 


Gender difference not statistical 


y significant 


Table B.1 in Appendix B shows the differences in ICCS scale scores across those countries with 
students in the same grade but whose age range spanned one year. This difference was quite large 


in Belgium (Flemish), Chile, 


Denmark, Italy, the Netherlands, and Peru. In these countries, younger 


students within the same grade achieved at least 30 scale points more than students one year older 


inthe same grade—a differe 


Associations between civic knowledge and socioeconomic background characteristics 


ICCS 2009 found that “the aspect of family background most strongly and consistently associated 
with civic knowledge was socioeconomic background” (Schulz et al., 2010, p. 216). However, the 
strength of the association between socioeconomic background and civic achievement varied 
greatly across countries. Other family-related aspects, such as student-reported involvement in 


political discussion, were not as strongly associated. 


To measure and report on socioeconomic background during ICCS 2016, we used responses from 
the student questionnaire. These related to parental occupational status, parental education, and 


nce equivalent to more than one-third of the width of a proficiency level. 


the number of books in the home, and were the same three socioeconomic background variables 
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used in ICCS 2009. Of the three, parental occupational status had the strongest association with 
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All three indicators of students' socioeconomic status contributed to a composite index of 
socioeconomic status. This index is included in the multilevel regression analyses presented in 


Chapter 7. 
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7 "All parents" refers to both parents when a student reported on the background of two parents or to one parent if the 
student reported on the background of only one parent. 
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CHAPTER 4: 


Aspects of students' civic engagement 


Chapter highlights 
Television news and discussions with parents remained important sources of information for 
students engaging with political and social issues. 


e Students’ use of newspapers declined between 2009 and 2016. (Table 4.1) 


n most countries, students were talking more frequently than previously with their parents 
bout what was happening in other countries. (Table 4.1) 


° 


e Students’ use of new social media for civic engagement remained limited but varied across 
participating countries. (Table 4.2) 


Students' engagement in discussions about political and social issues and their confidence to 
participate in civic activities were somewhat stronger than they were in 2009. (Tables 4.4, 4.6) 


e Students whoreported high levels of interest in political and social issues were the students 
most likely to discuss these issues. (Table 4.5) 


e Students who said they engaged confidently in civic activities also tended to be the students 
most interested in civic issues. There were no consistent associations between civic 
engagement and civic knowledge. (Table 4.7) 


While few changes were apparent in the extent of students' participation at school, students 
valued this participation as highly as they did in 2009. (Tables 4.8, 4.9) 


e Students willingness to participate at school was higher among females and among students 
who expressed higher levels of interest in social and political issues. (Table 4.12) 


e The associations between students’ willingness to participate at school and their civic 
knowledge were less consistent. (Table 4.12) 


Students' participation in voluntary activities and their expectations of engaging in elections 
increased in many countries between 2009 and 2016. (Tables 4.13, 4.17) 


e While the data analyses showed no associations between participation in legal protest 
activities and civic knowledge, the students who expected to participate in illegal protest 
activities were those most likely to have low levels of civic knowledge. (Tables 4.15, 4.16) 

e Expected active political participation was higher among students who said they were 


interested in civic-related issues but lower among students with higher levels of civic 
nowledge. (Table 4.20) 


O International Association for the Evaluation of Educational Achievement (IEA) 2018 
W. Schulz et al., Becoming Citizens in a Changing World, 
https://doi.org/10.1007/978-3-319-73963-2 4 
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Conceptual background and prior research 


This chapter addresses Research Question 3 of the ICCS 2016 assessment framework (Schulz, 
Ainley, Fraillon, Losito, & Agrusti, 2016): What is the extent of students’ engagement in different spheres 
of society and which factors within or across countries are related to it? This broad research question 
was accompanied in the ICCS 2016 framework with a subset of specific research questions: 


e What is the extent and variation of students’ civic participation in and out of school? 
e What beliefs do students hold regarding their own capacity to engage and the value of civic participation? 


e What expectations do students have regarding civic and political participation in the near future or as 
adults? 


e What changes in student engagement can be observed since 2009? 


n addressing these questions, the chapter examines: 


1) Students' personal engagement with political and social issues and their citizenship self- 
efficacy; 


Students' civic participation in school; 


Students' civic participation outside school; and 


Students' expected future civic engagement. 


Analyses reported in this chapter involve: 


Comparisons among participating countries in 2016; 


2) Comparisons between ICCS 2009 and 2016 for countries that participated in both cycles 
and where the same measure was used in each cycle; and 


3) Within-country associations between measures of civic engagement and selected independent 
variables. 


The selected independent variables were student interest in political and social issues, student 
level of civic knowledge, and either parental education (for measures of personal engagement 
with civic issues) or gender (for measures of civic participation at school, out of school, or beyond 
school); see category percentages for these variables in Appendix C. 


Because civic engagement of citizens is a central characteristic of a democratic society, one of ICCS 
2016's key goals was to measure the extent of students’ engagement with aspects included in civic 
and citizenship education. Civic engagement refers not only to students' personal involvement 
in activities related to this area but also to their motivation to participate in civic activities, their 
confidence in the effectiveness of their participation, and their beliefs about their own capacity to 
become actively involved. As Putnam (1995) points out, civic engagement is not narrowly confined 
tothe sphere of politics. He defines civic engagement as "people's connections with the life of their 
communities, not merely politics" (p. 665). 


A large body of literature concerns students' engagement as supported and encouraged by 
schools. One of the important contributions to the research literature on engagement has been the 
distinction between emotional engagement (positive and negative reactions to teachers, academic 
work, and school), behavioral engagement (involvement in academic, social, and extracurricular 
activities), and cognitive engagement (willingness to exert effort to comprehend complex ideas 
and master difficult skills) (Fredericks, Blumenfeld, & Paris, 2004). Our focus in this chapter is 
on students' behavioral engagement in civics and citizenship as well as their interest in various 
aspects of civics and citizenship. For each questionnaire scale, we compare scale score averages 
across three comparison groups, each consisting of two categories (e.g., students with high and low 
levels of civic knowledge). Graphical displays of differences between groups and their statistical 
significance (p « 0.05) accompany these comparisons. 
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The ICCS 2016 international student questionnaire was used to measure the constructs 
underpinning the scales and items presented in this chapter, while IRT (Item Response Theory) 
scaling was used to derive new scales. For reporting purposes, the |CCS 2016 scales have a mean of 
50 anda standard deviation of 10 with equally weighted national data. The 2016 scales employing 
the same or almost identical item sets to those used in ICCS 2009 equate to those established in 
2009. For these scales, 50 reflects the mean and 10 the standard deviation of all equally weighted 
countries that participated in ICCS 2009. In this chapter, we describe the scale score differences 
through reference tothe international standard deviations, which for the new scales reflect those 
in ICCS 2016 and for the equated scales those in ICCS 2009. 


All scales are described in item maps contained in Appendix D of this report. The maps map scale 
scores to expected item responses under the ICCS scaling model, which is also set out in Appendix 
D. Greater detail on the scaling and equating procedures for questionnaire items will be provided 
in the ICCS 2016 technical report (Schulz, Carstens, Losito, & Fraillon, forthcoming). 


When interpreting cross-country comparisons of questionnaire data, please be aware that the 
formats used to gauge respondents' attitudes or perceptions across diverse national contexts 
may not always measure respondents' beliefs consistently across the different languages and 
cultures (for evidence of this matter, see, for example, Desa, van de Vijver, Carstens, & Schulz, in 
press; Heine, Lehman, Peng, & Greenholtz, 2002; van de Gaer, Grisay, Schulz, & Gebhardt, 2012). 
Although ICCS extensively reviewed issues of measurement invariance during the development 
stage of both cycles of the study (see Schulz, 2009; Schulz & Fraillon, 2011), we acknowledge that 
variations of scale scores across countries may be partly due to differences related to cultural or 
linguistic contexts. 


Personal engagement with political and social issues 


Students’ civic engagement refers to students (a) gaining information about issues that arise in civic 
and political life; (b) discussing aspects of civic and political life with peers and adults; and (c) being 
disposed to actively engage in society. Civic engagement also concerns students' expectations of 
participating in civic activities in the future, and being able to actively engage in society. In addition 
to active involvement in the civic forums open to this age group (such as school-based activities, 
youth organizations, and community groups), many young people now become involved in the virtual 

d 

m 


networks featuring civic and political content that are available through social media. Today, there 
is wide recognition of the important role that formal education plays in influencing the extent of 
adult engagement in society (Pancer, 2015). 


According to Ekman and Amna (2012), we need to distinguish civic participation (latent political 
participation) from manifest political participation. Latent involvement includes characteristics 
such as interest and attentiveness, while manifest political participation takes the form of 
active engagement and involves activities undertaken either individually or collectively. Many 
commentators have observed the growing phenomenon of political passivity among young people, 
but as Amná & Ekman (2014) emphasize there is also a need to distinguish unengaged from 
disillusioned citizens. Although unengaged passive citizens may keep themselves informed and be 
willing to become engaged if needed, disillusioned passive citizens have lost faith in being able to 
exert an influence on civic practices and institutions and have accordingly become alienated from 
Civic processes. Therefore, in additionto active engagement, basic dispositions toward engagement 
(interest or self-efficacy) and behavioral intentions (underlying preparedness to take action) are 
of crucial importance in any study of young people's civic engagement. 


(CCS 2016 asked students how often they used both traditional sources (watching television, 
reading newspapers, and talking with parents) and social media to obtain information about political 
or social issues. The data point to an important role for television, a moderately important role 
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for discussions with parents, and a relatively smaller role for newspapers (Table 4.1). In 2016, an 
average of two-thirds of students (6696) in countries meeting sampling requirements watched 
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ofthe internet and social media in general but about use of these communication technologies for 
specific purposes related to civic engagement. 


The ICCS 2016 international average percentages for students' engagement with political and 
social issues through the internet and other social media at least once a week ranged from 31 
percent for using the internet to find information about political or social issues down to 10 percent 
for sharing or commenting on another person’s online post regarding a political or social issue, 
and nine percent for posting a comment or image regarding a political or social issue on internet 
or social media. 


Table 4.2: Students’ engagement with internet and social media 


Percentages of students who reported doing the following activities at least once a week: 
Country Using the internet to find Posting a comment or Sharing or commenting Average scale scores 
information about image regarding a political on another person’s indicating students’ 
political or social issues or social issue on the online post regarding a engagement with social 
(%) internet or social media political or social issue media 
(%) (%) 
Belgium (Flemish) 23 (1.1) V 5 (0.6 V 6 (0.4) V 48 (0.3) V 
Bulgaria 26 (0.9) vA 12 (0.9 A 11 (0.6) VAN 50 (0.3) 
Chile 21 (0.6 V 9 (0.5 8 (04) V 48 (0.2) V 
Chinese Taipei oS (10 A 20° (0:7 A 15 (0.6) VAN 57- (92) A 
Colombia 29 (0.9) V 11 (0.6 A^ 16 (0.8) A^ 51 (0.2) A 
Croatia 34 12 A 3 (04 V QUIM) V 49 (0.2) V 
Denmark! 38 (0.8) A 3 (03 V 4 (0.4) V 50 (0.2) 
Dominican Republic Si (2 A 19 (0.8 A 29 (09) À 54 (9:2) À 
Estonia! 26 (1.2) V 5 (04 V 8 (0.6) V 49 (0.2) V 
Finland 18 (0.9) v 0.3 V 3 (0.4) V 46 (0.2) v 
taly 35 (10 A^ 9 (0.5 10 (0.6) 51 (0.2) A 
Latvia? QUAE) A 14 (08 A 14 (0.7) N 59m 9) A 
Lithuania 37 (11 A 8 (0.6 9 (0.6) 52 (0.2) A 
alta 25 (0.7) Y 7 (04 x 8 (04) V 48 (0.2) V 
exico 29 (0.8) 12 (0.5 A 12 (0.5) A^ 50 (0.2) A 
etherlands! ORO) v 3 (03 V 55105) i 44 (0.2) v 
orway (9): 27 (0.7) V 4 (03 V 5 (0.3) V 49 (0.2) V 
Peru 3909) A^ Le (OW, A 18 (0.7) N 53 (0.2) A 
Russian Federation 4O (1.1) A^ 8 (0.5 O (0.6) 52 (0.2) A 
Slovenia 20 (0.9) v ST V 4 (0.4) V 47 (0.2) v 
Sweden! 33 (1.1) A^ 5 (0.5 V 7 (0.7) V 50 (0.2) 
ICCS 2016 average Sil (0:2) 9? (al © (91D) 50 (0.0) 
Countries not meeting sample participation requirements 
Hong Kong SAR 29 (1.0) 16 (08 16 (0.8) 52 (0.3) 
Korea, Republic of? Sg 8 (0.6) ‘AG (O17) 52" (0:2) 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia AS (EO) 8 (0.6) ZAROT EY 
(Germany) 


National percentage or average: 

A More than 10 percentage points or 3 score points above ICCS 2016 average 
A Significantly above average 

V Significantly below average 

WY More than 10 percentage points or 3 score points below ICCS 2016 average 


Notes: 

() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

T Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 90% to 9596 of National Target Population. 

? Country surveyed target grade in the first half of the school year. 
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ASPECTS OF STUDENTS’ CIVIC ENGAGEMENT 


In summary, we found significant associations across all countries between scores on the social 
mediaengagement scale and students’ interest in civic issues. We recorded only weak associations 
with parental education and no consistent associations between civic knowledge and social media 
engagement. 


ICES 


political and social 
hardly ever, “mont 


daily“ 


2016 asked students a series of questions regarding the frequency with which they discussed 


issues outside school. The questions had four response categories: “never or 


n 
H 


hly (at least once a month); “weekly (at least once a week); and “daily or almost 


The following items were used to measure students' discussion of political or social issues: (a) 


» 


"talking with parents about political or social issues" (ICCS 2016 average percentage of at least 
weekly discussions: 2596); “talking with friends about political or social issues" (1696); “talking with 
parent(s) about what is happening in other countries" (4696); and "talking with friends about what 
is happening in other countries" 


Weu 


avera 
ICCS 


to the one derived in th 


(2796). 


sed the responses to these items to derive an IRT scale reflecting the frequency of student 
discussion of political and social issues outside of school. The scale had a satisfactory international 
ge reliability (Cronbach's alpha = 0.74); see item map in Figure 4.2, Appendix D. Because 
2009 also used the items making up this scale, we were able to equate the 2016 IRT scale 


e previous cycle, thereby allowing us to examine not only the changes 


between 2009 and 2016 but also the associations between the average scores on this scale and 
the other indicators. 


The 2016 fin 


discu 


to over a third 


dings revealed variation across countries in the frequency with which students 


ssed political and social issues outside their schools; the difference between the country 
with the lowest and the country with the highest average score was four scale points (equivalent 


Peru. 


ofaninternational standard deviation). The students least likely to discuss civic issues 
outside school came from Chile and Mexico; those most likely to hold such discussions were from 
Denmark, Latvia, Lithuania, and 


The ICCS 2016 students engaged slightly more often (by more than two scale points or almost 
a quarter of an international standard deviation) than their 2009 counterparts in discussions of 
social and political issues outside school (Table 4.4). This difference suggests that students were 
discussing political and social issues outside school somewhat more often in 2016 than they were 


Thei 


stand 


Denn 


Stron 
socia 


country, discussion scale scores were high 
interested in political and 


moderate increases (equivalen 


in 2009. 


however, recorded no significant 


ard deviation) were record 


nark, Estonia, Slovenia, Lith 


g associations emerged between the 


ed in Swed 
t to aroun 
uania, and 


issues outside school and 


ncrease across the seven years was statistically significant in 12 countries; six countries, 
change. The largest increases (of more than half an international 


en, Finland, and Belgium (Flemish). We also recorded 
d a third of an international standard deviation) in 
Malta. 


frequency with which students discussed political and 


their interest in these issues (Table 4.5). In every participating 


er among students who said they were quite or very 


social issues than among the students who expressed little or no interest. 


On average, the difference was eight scale points (equivalent to more than three quarters of an 
international standard deviation), suggesting a consistently strong relationship between student 
interest in political and social issues and their propensity to discuss those issues outside school. 


In addition, in 


most countries, students with at least one parent who had attained a university 


degree discussed social and political issues more frequently than students whose parents had not 
attained a university degree. The difference was statistically significant in all but one participating 
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Table 4.4: National average scale scores indicating students discussion of political and social issues outside school 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 50 (0.3) V 45 (0.2) 5.3 (0.6) n m 
Bulgaria 51 (0.3) 50 (0.3) 0.9 (0.6) (e 
Chile 49 (0.2) V 49 (0.2) 0.1 (0.5) i 
Chinese Taipei 51 (0.2 y 49 (0.2) 1.9 (0.5) E T 
Colombia 51(02 V 51 (0.2) -0.4 (0.5) [m 
Croatia 59 (OA AN - - [| 
Denmark! 54 (0.2) A 50 (0.3) 4.0 (0.5) E E) 
Dominican Republic 52 WOO A 52 (0.2) 0.3 (0.5) O 
Estonia 52 (0.3) 49 (0.3) 2.9 (0.6) E B 
Finland Syl (OA) 46 (0.3) 4.9 (0.6) m EI 
taly 53 (0.2) A 52 (0.3) 0.9 (0.5) m 
Latvia 54 (02) A 58 (02) O (O15) LS 
Lithuania 54 (0.2) A 51 (0.2) 2.8 (0.5) E m 
alta SOLOA 5102) 25103) E D 
exico 49 (02 V 48 (0.2) 1.1 (0.5) mim 
etherlands! OOA V - - E) 
orway (9) 51 (0.2) V 49 (0.3) 2.2 (0.6) m m 
Peru 54 (0.2) A - - E 
Russian Federation 52 (0.2) 50 (0.3) 2.0 (0.6) m m 
Slovenia Sal (OX) ^w? 48 (0.2) 2.8 (0.5) = m 
Sweden 53 (Q3) A 47 (0.3) 6.4 (0.6) m m 
ICCS 2016 average 52 (0.0) 
Common countries average 52 (0.1) 49 (0.1) 228) (OAL) 
Countries not meeting sample participation requirements 
Hong Kong SAR 51 (0.3) - - E) 
Korea, Republic of? 51 (02) - - H 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 53 (0.3) - - IS 
(Germany)! 
lll] 2016 average score +/- Confidence interval 
Wl 200? average score +/- Confidence interval 
National percentage or average: On average across items, students with a score in the range with this color 


A More than 3 score points above ICCS 2016 average 


A Signi 
V Signi 


ficantly above ICCS 2016 average 
ficantly below ICCS 2016 average 


WY More than 3 score points below ICCS 2016 average 


Notes: 
() Stand 
Statistica 
(9) Coun 
T Metg 
1 Natio 

Coun 


ry surveyed target grade in 
No comparable data available. 


ard errors appear in parentheses. 
ly significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 

ry deviated from International Defined Population and surveyed adjacent upper grade. 
uidelines for sampling participation rates only after replacement schools were included. 
nal Defined Population covers 9096 to 9596 of National Target Population. 

he first half of the school year. 


country ( 


scale points, equivalent 


In 16 countries, studen 
the scale denoting disc 


knowledge scores were below Level B 


points (equivalent to a 
suggest a weak associa 
issues and their level o 


Dominican Republic 


toafi 


ts with 
ussion 


bout a f 


fth of an in 


tion between the 


have more than a 50% probability of indicating: 


Less than weekly 


Weekly or more 


. However, on average, th 
ternational sta 


of politica 
F 
fifth of an 


efer Table 4.5). 
international s 
frequency with 


f civic k 


nowledge. 


e difference was relatively small (just two 
ndard deviation). 


higher levels of civic knowledge had significantly higher scores on 
and social issues outside school than those whose civic 


On average, the difference was two scale 
tandard deviation). Overall, these results 
which students discuss political and social 


ASPECTS OF STUDENTS’ CIVIC ENGAGEMENT 


There is wide acceptance in the research literature that individuals’ “judgments of their capabilities 
to organize and execute courses of action required to attain designated types of performances" 
denote self-efficacy and that these judgements have a strong influence on the choices individuals 
make in regard to undertaking tasks, the effort they put into those tasks, and the extent to which 
they persevere with them (Bandura, 1986, p. 391). Consequently, students' sense of citizenship 
self-efficacy is widely considered as an important part of personal engagement with political and 
social issues. We defined students' sense of citizenship self-efficacy as students' self-confidence 


in undertaking specific behaviors in the area of civic participation. 


To assess this construct, ICCS 2016 included seven items 


that also featured in the ICCS 2009 


student questionnaire. The items were (a) "discuss a newspaper article about a conflict between 
countries" (ICCS 2016 average percentage of students expressing a fair or very good degree of 


confidence: 6596); “argue your point of view about a contro 


versial political or social issue" (6896); 


"stand as a candidate in a school election" (5996); “organize a group of students in order to achieve 
changes at school" (65%); "follow a television debate about a controversial issue" (5996); "write a 
letter or email to a newspaper giving your view on a current issue" (6096); and "speak in front of 
your class about a social or political issue" (6096). The items had similar levels of agreement, and 


we used them to derive an IRT scale with high average reli 
scale also equated with the scale derived in ICCS 2009 so 
the two ICCS cycles (see item map in Figure 4.3, Appendix 


Thenational average scale scores for students' sense of citize 
in range to the self-efficacy scores in 2009 (Table 4.6). The 2 
48 (Finland, Latvia, Netherlands) to 60 (Dominican Repub 
across the countries that also participated in 2016 was fro 


If civic and citizenship education had improved between 


ability (Cronbach's alpha = 0.84). The 
allowing us to compare scores across 
D). 


nship self-efficacy in 2016 were similar 
O16 average scale scores ranged from 
ic). In 2009 the corresponding range 
m 47 to 57 scale points. 


2009 and 2016, then a reasonable 


expectation is for a corresponding increase in citizenship se 
citizenship self-efficacy scores between 2009 and 2016 in 1 


f-efficacy. We observed an increase in 
2 of the 18 countries with comparable 


data across the two cycles. Latvia was the only country to show a decline in citizenship self-efficacy. 
The. five remaining countries showed no significant differences between 2009 and 2016. On 
average across the common countries, the increase was 1.5 scale points (equivalent to less than 


one fifth of an international standard deviation), indicating 


that the increase over seven years in 


students’ sense of citizenship self-efficacy was relatively small. 


Students who had at least one parent with a university 


degree had slightly higher levels of 


citizenship self-efficacy than other students (Table 4.7). Although this difference was statistically 


significant in 14 countries, it was very small, averaging just 
an international standard deviation). 


The ICCS 2016 data revealed strong to moderate associat 
scale scores and students’ interest in political and social i 


over one scale point (about a tenth of 


ions between citizenship self-efficacy 
ssues. In every participating country, 


the mean scale score for citizenship self-efficacy was significantly higher for students who were 
quite or very interested in political and social issues than for those with no or little interest. On 


average across the ICCS 2016 countries, this difference w 


as five scale points (equivalent to half 


an international standard deviation). While this pattern suggests a consistent and moderately 


strong associat 
social issues, it does not indicate any direction of causality. 


£ 


In 12 countries, citizenship se 


on between students' citizenship self-efficacy and their interest in political and 


-efficacy scores for students with higher levels of civic knowledge 


were slightly (but significantly) higher than the scores for the less knowledgeable students. 


However, in five countries (Chinese Taipei, Colombia, D 


ominican Republic, Mexico, Russian 


Federation), students with lower levels of civic knowledge had slightly but significantly higher 
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ASPECTS OF STUDENTS’ CIVIC ENGAGEMENT 


Table 4.6: National average scale scores indicating students’ sense of citizenship self-efficacy 
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Country 2016 2009 Differences 
(2016-2009) 35 40 45 50 55 on g 
Belgium (Flemish) 50(02 V 47 (0.2) 27 (0.4) "E 
Bulgaria 52 (03 A 50 (0.3) 1.6 (0.5) IER 
Chile 52 (0.2 52 (0.2) 0.1 (0.4) H 
Chinese Taipei 59 (0/2) 48 (0.2) 3.6 (0.4) LEN 
Colombia 53 (0.2 A 53 (0.3) 0.5 (0.4) D 
Croatia 54 (0.2 A - - E 
Denmark! 51 (0.2 V 50 (0.2) 1.1 (0.4) m" 
Dominican Republic (r) 60 (0.2) A 57 (023) 3.6 (0.5) E OB 
Estonia 49 (0.2 V 48 (0.2) 1.0 (0.4) LU 
Finland 48 (0.2 v 46 (0.2) 1.8 (0.4) mu 
taly 52 (0.2 51 (0.3) O.6 (0.4) Bü 
Latvia 48 (0.2 v 49 (0.2) -1.2 (0.4) EN 
Lithuania 51 (0.2 V 50 (0.2) 0.8 (0.4) Ü 
alta 50 (0.2 V 47 (0.3) 3.9 (0.4) E P 
exico 54 (0.2 A 53 (0.2) 1.5 (0.4) (E 
etherlands* 48 (0.2 v - - m 
orway (9) 51 (0.2 x 49 (0.3) 1.2 (O.5) i 
Peru 55 (0.2 A - - H 
Russian Federation 50(02 V 49 (0.2) 0.6 (0.4) B 
Slovenia 50 (0.2 V 50 (0.3) (QOO H 
Swede 52 (0.2) 49 (0.3) 2.6 (0.5) TI 
ICCS 2016 average 51 (0.0 
Common countries average Sl (Ol 50 (0.1) ESRO 
Countries not meeting sample participation requirements 
Hong Kong SAR 50 (0.2 = = a 
Korea, Republic of? 5903S - - H 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 49 (0.3 - - [| 
(Germany)! 
ll] 2016 average score +/- Confidence interval 
Wl 2009 average score +/- Confidence interval 
National average: On average across items, students with a score in the range with this color 


A More than 3 score points above ICCS 2016 average 
ficantly above ICCS 2016 average 
ficantly below ICCS 2016 average 
W More than 3 score points below ICCS 2016 average 


A Signi 
V Signi 


Notes: 
() Stand 
(9) Country deviated 
t+ Met guidelines for 
1 Natio 
Country surveyed 
No comparable da 


have more than a 5096 probability of indicating: 


Not or not very well 


Very or quite well 


ard errors appear in parentheses. Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 


rom international defined population and surveyed adjacent upper grade. 
sampling participation rates only after replacement schools were included. 


nal Defined Population covers 9096 to 9596 of National Target Population 


target grade in the first half of the school year. 
a available. 


An “(r)” indicates that data are available for at least 7096 but less than 8596 of students. 


scores than the 


more knowledgeable students. On average across countries, the difference was 


less than one scale point (equivalent to less than a tenth of an international standard deviation). 
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Students' participation in civic activities at school 


Evidence within the research literature suggests that more democratic forms of school governance 
can contribute to higher levels of political engagement among students (see, for example, Mosher, 
Kenny, & Garrod, 1994; Pasek, Feldman, Romer, & Jamieson, 2008). Based on their analyses of 


longitudinal data in the United Kingdom, Keating an 
school-based political activities tends to have a posi 


d Janmaat (2015) suggest that participation in 
tive influence on future civic engagement. The 


(CCS 2009 student questionnaire asked students about a wide range of civic-related participation 
at school (e.g., in school councils/parliaments or in student debates). The results from that cycle 
of ICCS showed majorities of students saying they had par 
school. Theseresults also revealed positive associations be 


civic knowledge (Schulz, Ainley, Fraillon, Kerr, & Losito, 201 


In order to assess students’ civic-related participation at s 
in the student questionnaire that were mostly identical to 

The following comparative presentation of results from 2016 and 200? sets out the percentages 
of students who had, within the past 12 months or a yea 


parliament representative;" (b) "took part in decision- 


"become a candidate for class representative or member o 


ticipated in many of these activities at 
tween civic participation at school and 
Q). 


chool, ICCS 2016 used a set of items 
the items used in the previous survey. 


r ago, (a) "voted for a class or school 


making on how their school was run;" or (c) 


f a school parliament" (see Table 4.8). 


Across the countries participating in [CCS 2016, 77 percent of students, on average, said that during 
or beforethe last 12 months they had voted for a class or school parliament representative. Forty- 
one percent said they had taken part in decisions on how their school was being run, and 42 percent 
reported having been a candidate for class representative or a member of a school parliament. 


On average across countries, the natio 


class or school parliament representati 
90 percent in three countries (Chile, Cro 


(Bulgaria, Italy, Netherlands). The natio 


than 50 percent in four countries (Domini 
percent in five other countries (Croatia, 


nal percentages of students who said they had voted for a 
ve ranged from 50 to 93 percent. Percentages were above 


atia, Norway) and below 60 percent in three countries 
nal percentages of students who said they had participated 
in decisions on the running of their school ranged from 20 to 64 percent. Percentages were greater 
can Republic, Mexico, Norway, Sweden) and below 30 
Estonia, Finland, Netherlands, Slovenia). The nationa 
percentages of students who said they had been a candidate for class representative or member 
of a school parliament ranged from 21 to 62 percent. Percentages were greater than 50 percent 


in four countries (Croatia, Dominican Republic, Norway, Slovenia) and below 30 percent in three 


countries (Italy, 


etherlands, Russian Federation). 


Over the seven years between ICCS 2009 and 2016, eight countries (Chinese Taipei, Denmark, 
Dominican Republic, Lithuania, Malta, Norway, Russian Federation, Sweden) saw significant 


increases in the percentages of studen 


ts who said they had voted for a class or school parliament 


representative (Table 4.8). We recorded significantly higher percentages of students who said they 


had participated in decisions about the run 


Estonia, Finland, Malta, Mexico, Nether 
in two countries. Six countries (Domin 


witnessed significant increases across ti 


acandidate for class representative or 


ican Rep 


a decline. On average across the com 


mon cou 


proportion of students reporting participation i 


three percentage points. 


ntries that 


Consideration of students' beliefs regarding th 


at school is important because of its close 


efficacy (Campbell, Gurin, & Miller, 1954). Althou 


2016 target age) are generally unable to vote or run 


ning of their school in nine countries (Chile, Denmark, 
ands, Norway, Sweden), and significantly lower percentages 
ublic, Finland, Lithuania, Malta, Mexico, Sweden) 
me inthe percentage of students who reported standing as 
member of a school parliament; two countries experienced 


participated in both ICCS cycles, the 


n all three activities increased (significantly so) by 


e value of participating in civic-related activities 
association with 


the more general concept of political 


gh adolescents at lower-secondary level (the ICCS 


for office in "adult politics; experimentation 
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ASPECTS OF STUDENTS’ CIVIC ENGAGEMENT 


as students can help them understand h 
schools (Ba 
students thought 


confidence in school participation (Torney-Purta, Lehmann, Oswald, & Schulz, 2001 


2009 student ques 


item to reflect students’ 


participatio 


The ICCS 2016 student questionnaire asked students to state their level of agreement with aset 
of five statements (items) on the value of participation at school: (a) “Student participa 


schools are runcan make schools better” (ICCS 2016 average percentage of students agreeing with 


tionnaire used a set of four (partly modified) CIVED items and one additiona 
ivic-related 
activities at school. While most students across the ICCS 2009 countries valued students’ 
n at school, females tended to give more positive responses than males to thi 
participation (Schulz et al., 2010). 


attitudes toward the value of student-based participation inc 


this item: 9096); (b) “Lots of positive changes can happen in schools when students wor 
(9396); (c) "Organizing groups of students to express their opinions could help solve problems 


in schools" (8796 


together rather than alone" (9096); and (e) "Voting in student elections can make a di 


what happens at schools" (8196). These items formed a reliable scale (Cron 
Figure 4.4, Appendix D. Because ICCS 2009 included the first four of these 
etoequate and then examine changes over time between the 2016 scale scores 
and the 2009 scale scores (Table 4.9). 


see the item map in 
items, we were ab 


The nation 
Colombia, 


al averages in ICCS 2016 ranged from 48 to 56 scale poi 
Dominican Republic) had average scale scores of 54 or greater, while the lowest average 


Ow they can collectively influence what happens in their 
ndura, 1997, p. 491). CIVED included seven items measuring the extent to which 
they had an influence at school. Four of these questions focused on genera 


. The ICCS 


this form of 


tion in how 


together” 


); (d) “Students can have more influence on what happens in schools if they act 


fference to 


bach's alpha = 0.78); 


nts. Three countries (Chile, 


scale score was 48 (Netherlands). There were significant increases in seven countries (Bulgaria, 


Chinese Ta 


ipei, Dominican Republic, Estonia, Italy, Lithuania, Mexico). A significantly | 
was recorded in one country. 


ICCS 2016 collected data that allowed us to explore possible associations betwee 
perceptions of the value of participation at school and student gender, students’ interest in political 
or social issues, and students’ level of civic knowledge (Table 4.10). A significantly lowe 


recorded in one country. 


We included student gender as an 
associations between gender and 
s of the value of participation at school again appeared to be related to stud 
ng countries, female students recorded higher values than males 
ue of participation at school scale, with the difference amounting to two scale points 


perception 
On average across the participat 


ont 


(equ 


sign 


he va 
ivalent to one fifth 


ificant in 16 of the common countries. 


of an international standard deviation). The difference was 


Ower score 


n students' 


r score was 


independent variable in ICCS 2016 because ICCS 2009 showed 
perceived usefulness of school participation. In 2016, students' 


ent gender. 


statistically 


We also found higher levels of interest in political and social issues associated with higher scores 


ont 


toa 


signif 


cou 


Ina 


paru 


he va 
value of participation at 
politi 
bout a third of an i 


calo 


fican 
tries 


, however. 


r social issues 


t associations 


countries, studen 
icipation at sch 


school scores between students who were quite or very in 
and those who had little or no interest was three scale points 


ue of participation at school scale. On average across countries, the difference in the 


terested in 
(equivalent 


nternational standard deviation). We observed similar and statistically 


in all participating countries. The associations varied in magni 


tude across 


ts with higher levels of civic knowledge scores tended to va 
ool more than students with lower levels of civic knowledge did. The difference 


ue student 


across countries was three scale points on average (equivalent to about a third of a standard 
deviation). 
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Table 4.9: National average scale scores indicating students' perception of the value of participation at school 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 49(02 V 50 (0.2 -0.3 (0.4) r3 
Bulgaria 5] (02) 49 (0.3 2.3 (0.4) mu 
Chile 55(02 A 56 (0.2 -1.4 (0.4) =" 
Chinese Taipei 5° (02 A 51 (09:2. 2.7 (0.4) E 5 
Colombia 54 (02) A 54 (0.2 -0.1 (0.4) nr 
Croatia 5950912) A - - @ 
Denmark! 49 (0.2) V 50 (0.2 -0.7 (0.4) m | 
Dominican Republic 56 (0.2) A 54 (03 1.7 (0.4) m 
Estonia 51 (0.3) 50 (0.3 1.1 (0.5) W 
Finland 50 (02) y 50 (02 0.4 (0.4) m 
taly 51 (0.2) 49 (0.2 2.1 (0.3) m 
Latvia ZO (02) y 48 (0.3 0.7 (0.4) (e 
Lithuania 49 (0.2) Vv 48 (0.2 0.8 (0.4) E) 
alta S02 SAOS -0.2 (0.4) LN 
exico 53 (02) A 51 (0.2 2.1 (0.4) m E 
etherlands 48 (02) e - - im 
orway (9) 51(02 V 51 (0.2 -0.4 (0.4) m 
Peru Sen OOF A - - E 
Russian Federation 50(02 V 50 (0.3 -0.5 (0.4) | 
Slovenia SOOL y 50 (05 0.4 (0.4) E. 
Sweden 49 (0.4) V 49 (0.2) 0.2 (0.5) eat 
ICCS 2016 average Got (eq) 
Common countries average Sl OI) Sil (Os 0.6 (0.1) 
Countries not meeting sample participation requirements 
Hong Kong SAR 48 (0.3) - - ismi 
Korea, Republic of? 51 (0.3) - - m 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 49 (0.4) - - 
(Germany)! = 
BW 2016 average score +/- Confidence interval 
Wl 2009 average score +/- Confidence interval 
National average: On average across items, students with a score in the range with this color 
A More than 3 score points above ICCS 2016 average have more than a 5096 probability of indicating: 
A Significantly above ICCS 2016 average No strong agreement with positive statements 
V Significantly below ICCS 2016 average Strong agreement with positive statements 


W More than 3 score points below ICCS 2016 average 


Notes: 
() Standard errors appear in parentheses. 
Statistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 9596 of National Target Population. 
? Country surveyed target grade in the first half of the school year. 
No comparable data available. 


ICCS 2016 included a question gauging students’ willingness to participate at school. The question 


DÉI DÉI 


asked students to rate the likelihood (“very likely; "quite likely,’ “not very likely,’ or “not at all likely") 
of them personally participating in the following civic activities if they had the chance to do so: 
(a) "vote in a school election for class or school parliament representatives;" (b) "join a group of 
students campaigning for an issue they agreed with;" (c) "become a candidate for class or school 
parliament representative;" (d) "take part in discussions in a student assembly;" and (e) "participate 


» 


in writing articles for a school newspaper or website: 
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The ICCS 2016 student questionnaire contained several i 


o = 


f participating at some future date i 
about a social or political issue. ICCS 
modifications in 2016 to the questio 
the results for the two cycles. 


The activities denoting social and pol 


(51%); (d) “collecting signatures for a 
forum about social or political 
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ticipated participation in i 
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igh correlation between the two 
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BECOMING CITIZENS INA CHANGING WORLD 


Across all ICCS 2016 countries, females had slightly (albeit significantly) higher scale scores than 


males (Table 4.18). On average, th 
an international standard deviatio 
political and social issues had signifi 


e difference was one scale point (equivalent to one tenth of 
n). In addition, students who were quite or very interested in 
cantly higher scale scores than the less interested students. In 


this instance, the average difference across countries amounted to four scale points, equivalent to 


more than athird ofan internationa 


Table 4.17: National average scale scores indicating studen 


standard deviation, and thus indicating a moderate association. 


ts’ expected electoral participation 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 

Belgium (Flemish) 49 (03) V 46 (0.2 30 (0.4) m m 
Bulgaria SOOS WA 48 (0.3 1.9 (0.4) m 
Chile 50(02) V 50 (0.3 0.3 (0.4) m 
Chinese Taipei 53/02 A Bal (L2 2.1 (6/3) == 
Colombia 53 (0.2) A 54 (0.2 -0.5 (0.3) n 
Croatia 51802) - - LI 
Denmark! 52 (02) A 49 (0.2 3.3 (0.3) E H 
Dominican Republic (r) 55 102) TA 52 (03 0.9 (0.3) E 
Estonia 48 (0.2) Y 47 (0.3 1.4 (0.4) m 
Finland S O2 y 49 (0.2 1.5 (0.3) m5 

taly 54 (0.2) A 54 (0.2 0.1 (0.3) E 

atvia 49 (02) V 50 (0.3 -0.7 (0.4) m | 
Lithuania 52 (02 A 52 (0.2 0.4 (0.3) rj 

alta 501012) y 49 (0.4 0.7 (0.4) E 

exico 52 (0.2) A 53 (0.2 -0.7 (0.3) r3 

etherlands* 47 (0.3) v - - [ | 

orway (9) 54 (01) A 52 (0.3 2.1 (0.4) m 
Peru 55(02 A - = E 
Russian Federation 51 (0.3) V 51 (0.2 -0.6 (0.4) CH 
Slovenia 50 (0.3) V 500 (O02 0.1 (0.3) = 
Sweden 53 (0.2) A 49 (0.3) 4.2 (0.4) Oo E 

ICCS 2016 average 51 (0.0) 
Common countries average 51 (0.1) 50 (0.1 dal (O11) 
Countries not meeting sample participation requirements 
Hong Kong SAR 47 (0.3) - - m 
Korea, Republic of? 51 (0.3) - - im 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 47 (0.4) - - = 
(Germany)! 

lll 2016 average score +/- Confidence interval 

National average: Wl 200? average score +/- Confidence interval 
A EES On average across items, students with a score in the range with this color 


A Significantly above ICCS 2016 average 
V Significantly below ICCS 2016 average 


W More than 3 score points below ICCS 2016 average 


Notes: 


have more than a 5096 probability of indicating: 


Certain or probable non-participation 


Certain or probable participation 


Statistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 
() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 


1 National Defined Population covers 90% to 95% of National Target Population. 


Country surveyed target grade in the first half of the school year. 


- No comparable data available. 


An “(r)” indicates that data are available for at least 70% but less than 8596 of students. 
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Another significant association across all CCS 2016 countries was that between expected electoral 
participation and civic knowledge. Students with higher levels of civic knowledge (at Level B or 
above) had significantly higher scores than the less knowledgeable students on the scale indicating 
expected electoral participation. On average, we found a difference of five scale points (equivalent 
to half an international standard deviation)—a difference that suggests a moderately strong 
association between civic knowledge and expected electoral participation. 


° 


To measure expected active political participation, the ICCS 2016 student questionnaire asked 
students to respond to a number of items that asked them how likely they would be to participate 
at some future date in the following activities: (a) "help a candidate or party during an election 
campaign" (ICCS 2016 average percentage of students expecting to probably or certainly do 
this: 44%): (b) "join a political party" (2696); (c) "join a trade union" (3296); (d) “stand as a candidate" 
(24926); and (e) “join an organization committed to a political or social cause" (34%). We used the 
students responses to form a scale that reflected students’ intended active political participation. 
The scale proved to be highly reliable, with an average Cronbach's alpha across countries of 0.85 
(see the item map in Figure 4.9, Appendix D). Because four of these items were used to measure 
this construct in ICCS 2009, we were able to equate the 2016 scale scores to the scale scores inthe 
previous cycle. The national average scale scores for 2009 and 2016 thus allowed an exploration 
of variations among the participating countries and changes between 2009 and 2016 (Table 4.19). 


In 2016, national average scores indicating expected active political participation scale ranged from 
46 (Belgium/Flemish) to 60 (Dominican Republic). The difference of 12 scale points represents a 
relatively large difference. Among the countries with comparable data from ICCS 2009, we found 
statistically significant increases in expected active political participation in nine countries (refer 
to Table 4.19). Two countries recorded 2016 scores that were significantly lower than the 2009 
scores; seven countries recorded no statistically significant differences. Overall, the increase in 
expected active political participation across the two cycles was very minor (less than one scale 
point). The Dominican Republic recorded the largest increase (of nearly three score points); the 
Russian Federation recorded the largest decrease (1.5 score points). 


Male students were more likely than female students to anticipate active political participation 
(Table 4.20). The difference, statistically significant in 16 ofthe countries, was small, however—only 
about one scale point (equivalent to one tenth of an international standard deviation). Students who 
said they were quite or very interested in political and social issues had higher scale scores than 
students with no or little interest in these issues. We observed statistically significant differences 
in all countries. On average, the difference across countries was three scale points (equivalent to 
almost a third of an international standard deviation). 


Expected active political participation tended to be negatively related to students' civic knowledge: 
scale scores indicating expected active political participation tended to be higher among students 
with civic knowledge scores below Level B than among students with higher levels of civic 
nowledge. This difference was statistically significant in 12 countries. We observed differences 
of two scale points (equivalent to one fifth of an international standard deviation), on average. 
This pattern of results is similar to the pattern reported in ICCS 2009. One possible explanation 
for this finding is that more knowledgeable students tend to have better grounds for carefully 
considering their personal active political commitments and the constraints associated with 
such an engagement. However, this rather counter-intuitive result certainly deserves further 
investigation in future studies. 
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Table 4.19: National average scale scores indicating students expected active political participation 
Country 2016 2009 Differences 
(2016-2009) 35 40 45 50 uS dO dB 

Belgium (Flemish) 46 (0.3) Y 45 (0.2 1.3 (0.5) i 
Bulgaria 50 (0.3) V 49 (0.3 1.2 (0.5) m 
Chile 50 (0.2) V 49 (0.2 1.1 (0.5) E 
Chinese Taipei SOOD V 47 (0.1 2.6 (0.4) [E 
Colombia 53 (0.3) A 53 (0.3 -0.1 (0.5) m 
Croatia 50 (0.2) - - = 
Denmark! 51 (0.1) 50 (0.1 0.6 (0.4) " 
Dominican Republic (r) 60(03) A 57 (04 2.8 (0.6) mu 
Estonia 48 (02 Vv 48 (0.2 O.1 (0.5) a 
Finland LOSS 48 (0.1 1.3 (0.4) TE 
taly 51 (0.2) 49 (0.2 1.4 (0.4) mu 
Latvia S002 V 5102 -1.2 (0.5) DR 
Lithuania 52 (0.2) A 49 (0.2 2.7 (0.5) HO 

alta 50 (012) iV 48 (0.4 1.6 (0.5) mu 

exico 55(02 A 54 (0.2 0.8 (0.5) m 

etherlandst 48 (0.2) vw - - H 

orway (9) 49 (0.1) V 49 (0.2 -0.2 (0.4) B 
Peru 56(02) A - - H 
Russian Federation 50(03) V 52 (0.2 -1.5 (0.5) EE 
Slovenia 49 (02 V 48 (0.2 0.7 (0.5) K! 
Sweden 50 (0.3) V 50 (0.2) 0.4 (0.5) LU 
ICCS 2016 average 51 (0.0) 
Common countries average 51 (0.1) SORON! 0.9 (0.1) 
Countries not meeting sample participation requirements 
Hong Kong SAR 48 (0.2) - - m 
Korea, Republic of2 50 (0.3) - - N 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 48 (0.3) - - E 
(Germany): 

lll] 2016 average score +/- Confidence interval 

National average: Wl 2009 average score +/- Confidence interval 
A More than 3 score points above ICCS 2016 average On average across items, students with a score in the range with this color 


A Significantly above ICCS 2016 average have more than a 5096 probability of indicating: 
V Significantly below ICCS 2016 average 


WY More than 3 score points below ICCS 2016 average 


Certain or probable non-participation 


Certain or probable participation 


Notes: 

() Standard errors appear in parentheses. 

Statistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 9096 to 9596 of National Target Population. 

Country surveyed target grade in the first half of the school year. 

No comparable data available. 

An “(r)” indicates that data are available for at least 7096 but less than 8596 of students. 
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CHAPTER 5: 


Students' attitudes toward important 
issues in society 


Chapter highlights 
Students differed in their perceptions of what is good or bad for democracy. 


e |nsomelCCS 2016 countries, lower-secondary students viewed situations such as political 
leaders giving government jobs to their family members as good for democracy, but in most 
other ICCS countries students viewed this practice as bad for democracy. ICCS recorded 
similar findings with respect to government interference in court decisions. (Table 5.1) 


* Across countries, students consistently saw free elections of political leaders, the right 
to peaceful protest, and equal rights for all ethnic/racial groups in a country as good for 
democracy. However, the ICCS students did not consistently regard the right to criticize 
the government or small differences in income in a country's populace as positive for 
democracies. (See Table 5.2) 


ICCS measured students' perceptions of what constitutes good citizenship both across and 
within countries. 


e |n 2016,the ICCS students tended to attach somewhat more importance to conventional 
good citizenship by adult citizens than the ICCS 2009 students did. (Table 5.3) 


e Students interested in political and social issues were also likely to regard conventional 
social-movement-related and personally responsible citizenship behaviors as important. 
(Tables 5.4, 5.6, 5.8) 

e Students tended to regard personally responsible citizenship behavior as important, with 

majorities of students regarding obedience to the law, ensuring the economic welfare of 

families, and respecting others' opinions as very important. (Table 5.7) 


Students expressed high levels of endorsement of gender equality and equal rights for all 

nic/racial groups in their countries. 

e Endorsement of gender equality varied across countries but that endorsement increased 

in a number of countries between 2009 and 2016. (Table 5.9) 

* Across all countries that participated in both ICCS 2009 and 2016 with comparable data, 
the 2016 students were more supportive than the 2009 students of equal rights for all 
ethnic/racial groups in society. (Table 5.11) 


e Females, students who expressed higher levels of interest in social and political matters, 
and students with higher civic knowledge scores were the groups most likely to endorse 
gender equality and equal rights for all ethnic/racial groups. (Tables 5.10, 5.12) 


Majorities of students viewed pollution, terrorism, water and food shortages, infectious 
diseases, and poverty as major threats to the world's future. 


e Major variations across countries with regard to these perceptions suggest the influence 
of local contexts. (Tables 5.13, 5.14) 

e Country variations were particularly substantial with regard to students’ concerns about 
water shortages and crime. (Tables 5.13, 5.14) 


O International Association for the Evaluation of Educational Achievement (IEA) 2018 
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Students trust in civic-related institutions, groups, and information sources changed between 

2009 and 2016. 

e [he ICCS 2016 students tended to express more trust than the 2009 students did in 
government, parliament, and courts of justice, but less trust in media and people in general. 

Tables 5.15, 5.16) 

* |n more established and economically stable democracies, students with higher civic 

nowledge scores tended to have higher levels of trust in civic institutions than those with 

ower levels of civic knowledge. In countries with perceived higher levels of corruption and 

ow government efficiency, this association was reversed, and more knowledgeable 

students expressed lower levels of trust in civic institutions. (Table 5.17) 


Students' endorsement of religious influence in society remained limited. 

e Only minorities among students across participating countries expressed support for 
religious influence in society. In four countries, significantly fewer students than in 2009 
expressed these views. (Table 5.18) 

e While, for students, more frequent attendance at religious services tended to be associated 
with higher levels of endorsement of religious influence in society, the associations between 
attendance, parental education, and levels of civic knowledge were generally negative ones. 
(Table 5.19) 


STUDENTS’ ATTITUDES TOWARD IMPORTANT ISSUES IN SOCIETY 109 


Conceptual background and prior research 


This chapter explores data relating to ICCS 2016 Research Question 4: What beliefs do students in 
participating countries hold regarding important civic issues in modern society and what are the factors 
associated with their variation? It presents data reflecting a range of different affective measures 
collected via the student questionnaire in relation to the following sub-set of research questions: 


e Whatare students beliefs regarding the importance of different principles underlying society? Analyses 
focus on students' beliefs about what is good or bad for democracy, their perceptions of what 
constitutes good citizenship behavior, and their endorsement of gender equality and equal 
rights for all ethnic and racial groups in their societies. 


e What are students’ perceptions of their communities and societies? Analyses focus on students’ 
beliefs about threats to the world's future. 


e What attitudes do students hold toward civic institutions and society? Analyses address students’ 
perceptions of civic groups, institutions, and sources of information as well as the extent to 
which students endorse the influence of religion in society. 


e What changes in student beliefs can be observed since 2009? Analyses center on the affective- 
behavioral measures comparable across the two ICCS cycles, but include data only from those 
countries that participated and met IEA sample participation standards in both ICCS surveys. 


The ICCS 2016 assessment framework (Schulz, Ainley, Fraillon, Losito, & Agrusti, 2016) defines 
the affective-behavioral domain attitudes as judgments or evaluations regarding ideas, persons, 
objects, events, situations, and/or relationships, and acknowledges that individuals can harbor 
contradictory attitudes at the same time. Attitudes encompass responses that focus on specifics 
and can change over time, as well as those reflecting broader and more fundamental (or deeply 
rooted) beliefs that tend to be constant over longer periods of time.* 


In line with the approach described in Chapter 4, ICCS used a student questionnaire to measure 
the constructs underpinning the scales and items presented in this chapter and used IRT (Item 
Response Theory) scaling to derive new reporting scales, all with a mean of 50 and a standard 
deviation of 10 with equally weighted national data either for 2016 or, where equated, for 2009. 
Details about scaling and equating will be presented in the ICCS 2016 technical report (Schulz, 
Carstens, Losito, & Fraillon, forthcoming). Item maps describe the scales presented in this chapter. 
The maps, which map scale scores to expected item responses under the scaling model, can be 
found in Appendix D. Readers should remain aware that, as with the scales presented in Chapter 
4. cross-national differences of scale scores need to be interpreted with some caution because 
questionnaire formats may not always provide consistent measurement across the diversity of 
languages, cultures, and national contexts evident in the ICCS countries. 


The chapter also reviews associations between the above measures and selected variables such as 
students' civic knowledge, gender, interest in political or social issues, use of media, and attendance 
atreligious services. For each questionnaire scale, we compare scale score averages across three 
different comparison groups, each consisting of two categories (e.g., students with high and low 
levels of civic knowledge). Graphical displays of differences between groups and their statistical 
significance (p « 0.05) accompany those comparisons. 


1 The ICCS 2009 assessment framework (Schulz, Fraillon, Ainley, Losito, & Kerr, 2008) conceptualized more enduring 
beliefs as "value beliefs" as opposed to the less enduring and more changeable "attitudes" However, the ICCS 2016 
assessment framework made both part of the same affective-behavioral domain attitudes on the premise that students 
of the surveyed age group are relatively unlikely to have already formed enduring beliefs. 
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Students' attitudes toward democracy and citizenship 


Gathering data on students' views of democracy has been a key aspect of all IEA studies of civic 


and citizenship education. The first | 
different aspects of the democratic sys 


[he IEA CIV 


characteristics of society as either "good or bad for democracy.’ The responses to 
showed students regarding some of the characteristics quite differently across 
countries (see Husfeldt & Nikolova, 2003; Torney-Purta, Lehmann, Oswald, & Schu 


(CCS 2009 used a modi 


EA Civic Education Study in 1971 required students to rate 
tem of government (Torney, Oppenheim, & Farnen, 1975). 


D 1999 survey included a question asking students to describe several different 


this question 
participating 
z, 2001). 


fied set of nine items to measure the extent to which students agreed 


with statements reflecting what a democratic society should be like. The 2009 questionnaire 


w 


The results showed very large majorities of students across all participating coun 
endorsing many of the aspects typically regarded as essential for democracy, such as democratic 
elections of political leaders (Schulz, Ainley, Fraillon, Kerr, & Losito, 2010). 


so included three items that asked students to what extent they thought governments should 
impose restrictions on personal rights in response to groups that pose threats to nati 


onal security. 


The ICCS 2016 assessment framework (Schulz et al., 2016) defines civic principles 


tries strongly 


as one of the 


content domains focused on the shared ethical foundations of society. This domain encompasses 
equity, freedom, sense of community, and rule of law as its sub-domains. All four of these relate to 
democratic principles. The ICCS 2016 student survey consequently included measures of young 
people's beliefs about what constitutes a democratic society. ICCS 2016 used a different item 


format, however, in order to assess students' views of democracy. 


The format resembled that used in CIV 
situations in a society as "good; "bad; or “ 


D 1999, and it required students to rate the following 
neither good nor bad" for democracy: (a) "Political leaders 


give government jobs to their family members;" (b) “One company or the government owns all 


newspapers in a country;" (c) “People are allowed to publicly criticize 


the government;"(d) “All 


adult citizens have the right to elect their political leaders;" (e) “People are able to protest if they 
think alawis unfair;" (f) “The police have the right to hold people suspected of threatening national 


“ 


security in jail without trial;" (g) "Differences in income between poor and rich people are small; 
(h) “The government influences decisions by courts of justice;" and (i) "All «ethnic/racial» groups 


in the country 


have the same rights.” 


Table 5.1 shows the percentages for those perceptions that majorities of surveyed students tended 
to view as relatively bad for democracy. It displays the percentages of students who 
situation as good (to the left of each bar chart), neither good nor bad (in center), or bad (to the 
right). The proportions of responses are also graphically displayed as a bar chart a 
the three category percentages. Percentages of students rating a situation as good or bad are 


displayed in bold wherever they were significantly high 


(“good” versus. "bad"). 


In most countries, the percentages of students who considered government officia 


to family membe 


Students' perceptions in this group of countries may be influenced 


younger people in this region (Morris & Blake, 2010; Torgler & Valev, 2004). 


viewed each 


bove each of 


er than those in the "opposite" category 


s giving jobs 


rs as bad for democracy were significantly higher than the percentages of those 
students who regarded this practice as good for democracy (see Table 5.1). 
countries (Colombia, Italy, Malta, Mexico, Peru), a quarter or more of studen 
situation as good for democracy, while in the Dominican Republic more than half o 
held this view. 
higher levels of acceptance of, as well as more widespread experiences with, 
something which has been observed in many Latin American countries, and in part 


However, in several 
ts consi 


dered such a 
the students 
by generally 


this type of practice, 
icular among 
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When students were asked about the situation where a company or the government owns all th 
newspapers in a country, relative majorities of students (5296 on average) across participating 
countries consistently viewed these media monopolies as bad for democracy. In most countries, 
students also viewed a situation where a government influences court decisions as bad for 
democracy. However, on average across the ICCS 2016 countries, only 35 percent of the student 
endorsed this view. In Colombia, Malta, Mexico, and Peru, between a quarter and athird of student 

felt that the situation of governments influencing court decisions was good for democracy. In 
the Dominican Republic, 43 percent were of this opinion, while only 20 percent considered the 
situation as bad for democracy. 


(D 


S 
S 


On average across countries, a third of the lower-secondary students thought that letting the 
police hold suspects for national security reasons indefinitely in jail is bad for democracy; 30 percent 
considered it as good for democracy, and 37 percent thought it neither good nor bad. There was 
considerable variation across countries in these views. Although 40 percent or more of the students 
considered this situation as bad for democracy in Chile, Chinese Taipei, and Colombia, 40 percent 
or more viewed it as good for democracy in Bulgaria, Croatia, and the Dominican Republic. 


Table 5.2 shows the results for situations that tended to be viewed as good rather than bad for 
democracy by relative majorities of lower-secondary students. On average cross-nationally, 
more than half of the students thought that allowing adult citizens to elect their leader freely, 
allowing people to protest peacefully against laws they think are unfair, and giving the same rights 
to all ethnic and racial groups in a country are good for democracy. In most countries, relatively 
more students thought that allowing people to criticize the government is good for democracy 

n 

n 


(compared to those who regarded this practice as bad). However, more than a third of students i 
six countries regarded this situation as bad for democracy (Chinese Taipei, Colombia, Dominica 
Republic, Latvia, Mexico, Peru). Forty percent or more of students in seven countries agreed that 
small differences in income between rich and poor people are good for democracy. In three Latin 
American countries (Chile, Colombia, Peru), about a third of students regarded this situation as 
bad for democracy. On average across participating countries, 42 percent of students viewed 
income differences as unrelated to democracy. 


ajorities of students across the participating countries consistently regarded the right to 
democratically elect leaders, ability to protest against unjust laws, and equal rights for all ethnic and 
racial groups as good for democracy. Less consistent patterns of agreement were apparent with 
respect to people being able to publicly criticize governments or live in societies with only small 
differences in income. In particular, the finding that students in a number of countries believed 
that criticizing governments is bad for democracy may suggest a legacy of authoritarian views 
with regard to how democracies should function. In this context, it should also be noted that the 
students inthese countries were characterized by relatively low average levels of civic knowledge 
(see Chapter 3). 


The ICCS 2016 assessment framework regards young people's views of what constitutes good 
citizenship behavior as an important aspect of their attitudes toward society. The first IEA study 
oncivic education in 1971 included several items measuring this aspect (Torney et al., 1975), while 
the second IEA study in this learning area, CIVED 1999, developed a question asking students 
to rate the importance of 15 different behaviors commensurate with being a good citizen (see 
Torney-Purta et al., 2001, p. 77f). Two dimensions emerged from the data. One was concerned with 
conventional citizenship behavior; the other with social-movement-related citizenship activities 
(see Schulz, 2004). |CCS 2009 included a similar set of 12 items measuring students’ perceptions of 
the norms of adults’ good citizenship behaviors; the set was presented in a different question format, 
however. Results showed the same two dimensions of conventional and social-movement-related 
citizenship identified from the CIVED 1999 data (Schulz et al., 2010; Schulz & Friedman, 2011). 
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Table 5.1: Students' perceptions of situations that are typically regarded as bad for democracy 


Country Percentages of students viewing the following situations as good, neither good nor bad, or bad for democracy: 

Political leaders give government jobs to their One company or the government owns all newspapers 
family members in a country 

Good (%) Neither good nor bad (%) Bad (96) Good (%) Neither good nor bad (96) Bad (96) 
Belgium (Flemish) C NENNEN 1 1 1 1 1| uw 
14 (O.9) 43 (13) 43 (1.6) 9 (07) 35 (1.1) 56 (14) 
Bulgaria L NENNEN 1 5 L NENNEN 1) |! 
TPP 320) BILA 50 (14) 15 (0.8) 42 (1.1) 43 (1.1) 
Chile | eee 
18 (0.6) 42 (0.9) 40 (1.0) 11 (0.6) 44 (1.0) 45 (1.1) 
Chinese Taipei C Wm O O ] ]|] ] 1] l| E —$ EN 
10 (0.5) 16 (0.8) 74 (0.9) 13 (0:5) 28 (1.0) 59) (12) 
Colombia Co ë RN ` å | 
28 (1.4) 51 (1.2) 21 (0.9) 9 (0.6) 44 (0.7) 47 (1.0) 
Croatia 1 RN hhh As — — ] 1 | 1 1L. 
T (Oá) BB (A) 55: (1.2) 55) 31 (10) 63 (1.2) 
Denmarkt L E — Á|—|] [| | L aasan 1: 
7 (0.4) 40 (1.0) 53 (1.1) 6 (04) 31 (1.1) 63 (13) 
Dominican Republic (r) EE — ——— ý [ EE i 
54 (1.2) 33 (1.0) 1 (LO 19 (0.8) 40 (0.9) 42 (1.2) 
Estonia‘ [L NMEEEEMZ — —— 5 5$ [LENEEEEN — 8 — — 
8 (0.7) 41 (1.1) 51 (12) 5 (0.4) 32 (12) 63 (14) 
Finland [NENNEN — L[LNEEEEEN — 80 0 
5 (04) 91 GS 63 (1.0) 4 (04) 27 (1.0) 69 (1.0) 
taly — —-———— — ý Oò "` RR 
30 (0.8) 29 (0.8) 41 (1.1) 4 (07) 39 (0.9) 47 (10) 
Latvia! L MEN å j L NE — 5 
12 (0.8) 35) (12) 53 (12) O (0.6) 36 (13) 54 (1.0) 
Lithuania "RN å | ees TTT å -y ýġýOòů 
12 (07) 40 (12) 48 (1.3) 3 (07) 36 (1.1) 51 (1.1) 
alta Rm os ll 
26 (0.8) 38 (0.8) 36 (0.9) 4 (0.6) 41 (0.9) 45 (1.1) 
exico RR À$1 | ` 
25 (0.8) 47 (08) 29 (10) 3 (0.6) 50 (0.7) 37 (08) 
etherlandst ee ll Se 
10 (0.8) 32) (43) 57 (1.6) 9 (0.8) 34 (1.2) 57 (1.6) 
orway (9): [ RN å å er re eee 
21 (0.7) 48 (0.7) 31 (0.7) 7 (0.6) 37 (0.7) 46 (0.9) 
Peru L——  ——-X 1 rr 
29 (1.0) 43 (0.9) 28 (1.0) 4 (0.6) 43 (0.8) 42 (1.0) 
Russian Federation "RR L RN — | 
16 (O.8) 45 (13) 39 (1.7) 2 (07) 40 (13) 48 (1.7) 
Slovenia L NMEEEONM — $1 5$ — L MEN å 5|] — 
9 (0.7) 41 (12) 50 (1:3) 9 (0.6) 35 (L1) 56 (13) 
Sweden: (r) C EN ` ` L E E) 
14 (1.0) 44 (1.0) 42 (1.1) 8 (0.5) 33 (14) 59 (1.5) 
ICCS 2016 average L EN L ` 
17 (0.2) 39% 102) 44 (0.3) ib (G) 37 (0.2) 52 (0.3) 
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Percentages of students viewing the following situations as good, neither good nor bad, or bad for democracy: 


The police have the right to hold people suspected of threatening 
national security in jail without trial 


The government influences decisions by courts of justice 


Good (%) Neither good nor bad (%) Bad (%) 


Good (%) Neither good nor bad (%) Bad (%) 
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Table 5.2: Students' perceptions of situations that are typically regarded as good for democracy 


Country Percentages of students viewing the following situations as good, neither good nor bad, or bad for democracy: 
People are allowed to publicly criticize the government All adult citizens have the right to elect their political leaders 
Good (%) Neither good nor bad (%) Bad (96) Good (%) Neither good nor bad (96) Bad (96) 
Belgium (Flemish) (ee | LOL MEM 
55 (12) 38 (1.1) 7 (0.5) 88 (0.8) 0 (07) 2 (03) 
Bulgaria Lec E —. [uem CN ii 
35 (11) 42 (0.9) 23 (10) 76 (0.9) 8 (0.8) 6 (0.6) 
Chile L. ë Hwaw — | LLL NEMO | 
43 (0.8) 41 (0.8) 16 (0.5) 78 (0.9) 8 (07) 4 (04) 
Chinese Taipei C ` ` NENNEN y E  NENM |! 
gavit) 24 (0.9) 39 (10) 82 (0.9) 5 (08) G9) 
Colombia [ BE å (Eee) 
28 (0.9) 38 (0.8) 34 (1.0) 86 (0.7) 2 (0.6) 3 (0.3) 
Croatia el [ jma 
43 (1.2) 41 (1.1) 16 (07) 86 (0.7) 2 (07) 2 (03) 
Denmark: (OE èë å ë L[ jw 
39 (1.1) 43 (0.8) 18 (0.7) 84 (0.8) 3 (07) 2 (03) 
Dominican Republic (r) L ` E . — —  ] | 1 a! TE 
23 (0.9) 30 (0.9) 47 (1.1) 81 (0.8) SA07) 4 (03) 
Estonia! L  - A å å [ jma 
31 (14) 40 (1.0) 29 (12) 80 (0.9) 6 (0.9) 4 (04) 
Finland — — — uu ` L[.——————— — Rm 
53 (10) 40 (11) 7 (0.5) 82 (0.8) 7 (08) 2 (0.2) 
taly OE EES [ jaa 
39 (1.1) 36 (0.9) 25 (0.8) 81 (0.9) 4 (07) 5 (0.4) 
Latvia’ L e ima å å [ jma | 
27 (42) 38 (1.0) 35 (12 71 (0.9) 29: (08) 6 (0.5) 
Lithuania — — EE — — $5 © as 
35 (10) 32 (0.9) 34 (0.9) 76 (0.8) 8 (0.8) 6 (0.5) 
alta C — — J q ` å TU | 
35 (1.0) 42 (0.8) 23 (07) 66 (0.8) 28 (0.7) 7 (04) 
exico C WEN  — jJ: =— NENNEN! 
20 (0.9) 42 (0.8) 38 (1.1) 72 (0.9) 23 (0.8) 4 (03) 
etherlands! [ jHjww s | =—a ! 
54 (1.3) 38 (12) 8 (0.7) 86 (11) 1 (10) 3 (04) 
orway (9): [ Eel E&E Ju 
43 (0.9) 39 (0.8) 19 (0.6) 75 (0.7) 21 (0.6) 3 (03) 
Peru — GNE —— 5 ————Ó — 
28 (0.9) 39 (1.0) 32 (1:0) 80 (0.7) zv) 4 (03) 
Russian Federation C — MEM O L———————— — — — MEM | 
36 (13) 37 (0.9) 28 (10) 79 (12) 6 (10) 5 (0.4) 
Slovenia CN ý O © — Rm 
38 (1.5) 42 (12) 20 (10) 84 (0.9) elato) 3 (04) 
Sweden! (r) Ee Loo 
52 (1.1) 34 (1.0) 14 (0.8) 83 (1.0) 3 (0.6) 5 (0.8) 
ICCS 2016 average L———— — MEE  — ——— Im 


38 (0.2) 38 (0.2) 


80 (0.2) 


Countries not meeting sample participation requirements 


Hong Kong SAR 


o 
S 
= 
M 


N 
N 
= 
& 
EN 


e 
E 


Korea, Republic of? 


63 (1.6) 27 (15) 10 (07) 
Co —— MEE ` 
52 (11) 38 (11) 10 (0.6) 


N 
b 
S 
CO 


N 
Ba 
o 
E) 
GA 


o9 
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Benchmarking participant not meeting sample participation requirements 


North Rhine-Westphalia 
(Germany)! 


52 (17) 30 (1.5) 18 (14 


NI 
A 
= 
= 


[o 
= 
oS 
[9 


= 
ios) 


IB] Percentage good for democracy 


Notes: 


Wü Percentage neither good nor bad 


( Standard errors appear in parentheses. 
Percentages of students rating a situation as good or bad that are significantly larger (p < 0.05) than those in the opposite category (bad or good) are displayed in bold. 
9) Country deviated from International Defined Population and surveyed adjacent upper grade. 


National Defined Population covers 9096 to 9596 of National Target Population. 


( 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 
2 


Country surveyed target grade in the first half of the school year. 
An “(r)” indicates that data are available for at least 7096 but less than 8596 of students. 


E Percentage bad for democracy 
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Percentages of students viewing the following situations as good, neither good nor bad, or bad for democracy: 
People are able to protest if they think a law Differences in income between poor and All «ethnic/racial» groups in the country have 
is unfair rich people are small the same rights 
Good (%) Neither good nor bad (96) Bad (%) Good (%) Neither good nor bad (%) Bad (%) Good (%) Neither good nor bad (%) Bad (%) 
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Kennedy (2006) distinguished active (conventional and social-movement-related) from more 
passivecitizenship elements (national identity, patriotism, loyalty). Other scholars studying young 
people's views of ideal citizenship behavior (e.g., Abs, 2013) have drawn similar distinctions. 
Although the ICCS 2016 student questionnaire included the same question as in the previous cycle, 
the ICCS research team augmented it with a number of additional items reflecting more passive 


forms of citizenship behavior. This addition formed a distinct dime 


responsible citizenship behavior. 


The 2016 questionnaire asked students to rate the importance of adu 
behaviors encapsulated in the following items: (a) "voting in every na 
average percentage of students rating the behavior as quite or very important: 8196); (b) "joining 
a political party" (quite or very important: 3296); (c) "learning about t 


nsion reflecting personally 


ts’ conventional citizenship 
tional election” (ICCS 2016 


a 


he country’s history” (quite 


or very important: 79%); (d) "following political issues in the newspaper, on the radio, on TV, or on 
the internet” (quite or very important: 76%); (e) “showing respect for government representatives” 
portant: 
that the 


(quite or very important: 84%): and (f) “engaging in political di 
44%). We used the items to form an IRT scale and then equ 


value of 50 reflected the average score of equally weighted countries in the previous cyc 
scale had satisfactory average reliability (Cronbach's alpha = 0.71) across countries (see i 


in Figure 5.1, Appendix D). 


Table 5.3 shows the national scale scores for students' perceptions of the import 
conventional citizenship in participating countries and, in comparison, with the resu 


2009. National average scores are also displayed on the righ 


scussions" (quite or very im 
ated it with ICCS 200? so 


t-hand graph as boxes that 


the scores’ respective confidence intervals. Scale scores located in the lighter colored area 


that, on average, respondents were likely to have rated conventional citizenship behavi 
portant. 


important, while those located in the darker colored area wou 


Id not have rated them as im 


The Dominican Republic, Italy, Mexico, and Peru recorded the highest scale scores for s 


perceptions of the importance of conventional citizenship. Be 


Netherlands, and Slovenia recorded the lowest scores. In nine 


um (Flemish), Estonia, Fin 


gi 


Ce 


a 


in 
in 


LU 


e. The 
mmap 


nce of 


Its from ICCS 


dicate 
dicate 
ors as 


dents' 


a 


nd,the 


countries, the ICCS 2016 scores 


were significantly higher than the 2009 ones. On average across the 2009 and 2016 countries with 


comparable data (referred to as “common countries" in the tab 


score-point difference of just over one scale point. 


es in this chapter), we observed a 


Table 5.4 shows the associations between students’ perceptions of the importance of conventional 
gender (male or female), students' 
e with little or no interest in political 
or social issues), and civic knowledge (student at or above Level 2 versus others). The columns 
g., males and females), while the bar 
ssociation: the red bars to the left of 
nthe first (left-hand side) group had 
icate score point differences where 


citizenship and (dichotomous) variables reflecting students' 
interest (those who were quite or very interested versus thos 


depict the average scale scores for each comparison group (e. 


chart in between graphically illustrates the direction of each a 


the zero line indicate score point differences where students i 


^ 


significantly (p < 0.05) higher values, while the green bars ind 
the other group had significantly higher averages. 


Of the associations between students' perceptions of the importance of conven 
and the dichotomous variables, the most marked were those between perceptions 


tional citizenship 
andcivicinterest. 


We found consistent and statistically significant positive associations between these two variables: 


on average across all countries, we observed a four-point difference between s 


tudents with high 


and students with low interest in political and social issues. Female students in six countries had 
slightly but statistically significant higher scores than male students. The only country where males 
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Table 5.3: National average scale scores indicating students’ perceptions of the importance of conventional citizenship 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 48 (02) Y 46 (0.2) 2.2 (0.5) m 
Bulgaria 50 (0.3 V 4902) 0.8 (0.5) E) 
Chile 51 (0.3 51 (0.2) -0.7 (0.6) [M 
Chinese Taipei 52 OAA 50 (0.2) 157305) | m 
Colombia 52 (0.2 A 52 (0.2) 0.1 (0.5) D 
Croatia 59-102 A - - imi 
Denmark? 50 (0.2 V 48 (0.2) 2.2 (0.5) E E 
Dominican Republic 58 (O3 A 55 (0.3) 2.8 (0.6) m m 
Estonia! 48 (0.3 v 47 (0.2) 0.4 (0.5) (e 
Finland 48 (0.2 v 45 (0.2) 2.6 (0.5) E m 
taly 55 (0.2 A 54 (0.2) 0.7 (0.5) i 
atvia! 50 (0.3 V 50: (0.2) QA (05) Ir] 
thuania 52(02) A 51 (0.2) 1.5 (0.5) mm 
alta 50 (0.2 V 50 (0.3) OOS) m 
exico 55 (0:9 A 54 (0.2) 1.0 (0.5) E| 
etherlandst 48 (0.3 v - - im 
orway (9)! 51 (0.1 V 49 (0.2) 1.3 (0.5) mu 
Peru 55 (0.2 À - [| 
Russian Federation 52 (0.3 VAN 53 (0.3) 0.5 (0.6) m 
Slovenia 48 (0.3 v AG (OW) 15 (05) TE 
Sweden 49 (0.3 V 46 (0.2) 3.0 (0.5) m m 
ICCS 2016 average 51 (0.1) 
Common countries average SL (Ml 50 (0.1) ALD (O11) 
Countries not meeting sample participation requirements 
Hong Kong SAR 51 (0.2 = - imi 
Korea, Republic of2 59 (0/9 - - im 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia? 48 (0.4 - - = 
(Germany) 
Jl] 2016 average score +/- Confidence interval 
Wl 200? average score +/- Confidence interval 
National average: On average across items, students with a score in the range with this color 
A More than 3 score points above ICCS 2016 average have more than a 50% probability of indicating: 
A Significantly above ICCS 2016 average Not very important or not important at all 
V Significantly below ICCS 2016 average Quite or very important 


W More than 3 score points below ICCS 2016 average 


Notes: 
() Standard errors appear in parentheses. Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
t+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 9596 of National Target Population. 
Country surveyed target grade in the first half of the school year. 
No comparable data available. 


had slightly but significantly higher scores than females was Peru. Our examination of associations 
between students' perceptions of the importance of conventional citizenship and students' level 
of civic knowledge showed five countries where students with higher levels of civic knowledge 
had significantly higher scale scores and four countries where students with lower levels of civic 
knowledge had significantly higher scores. 
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The following items in the student questionnaire were used to measure students' perceptions 
of the importance of social-movement-related citizenship behavior: (a) "participating in peaceful 
protests against laws believed to be unjust" (ICCS 2016 average percentage of students rating 
the behavior as quite or very important: 6296); (b) "participating in activities to benefit people in 
the local community" (quite or very important: 8296); (c) “taking part in activities promoting human 
rights" (quite or very important: 8496); and (d) "taking part in activities to protect the environment" 
(quite or very important: 86%). The items formed a scale that had satisfactory average reliability 
(Cronbach's alpha = 0.74) across countries (see item map in Figure 5.2, Appendix D). 


Thecountries where students most strongly endorsed the importance of social-movement-related 
behavior were Bulgaria, Colombia, the Dominican Republic, Italy, Mexico, and Peru; those where 
students were least likely to endorse this behavior were Denmark, Finland, and the Netherlands 
(Table 5.5). Countries where the 2016 students assigned relatively higher importance to these 
behaviors than the 2009 students did were Belgium (Flemish), the Dominican Republic, Finland, 
Italy, Slovenia, and Sweden. In two countries (Chile and Latvia), the 2016 students' scale scores 
were significantly lower than the scores of their 2009 counterparts. On average, the 2016 data 
revealed a very small but statistically significant increase of 0.3 of a score point across the common 
countries. 


Females in 16 countries were significantly more likely than males to gain higher scores on the 
social-movement-related behavior scale (Table 5.6). We observed a small but statistically significant 
difference of one score point, on average, between females and males. We also found consistent 
positive associations between students' interest in political and social issues and their perceptions 
ofthe importance of social-movement-related citizenship behavior: across countries, the difference 
between the two comparison groups (not interested and quite/very interested) amounted, on 
average, to three scale score points (equivalent to about one international standard deviation). 
n most countries, students at or above Level 2 on the civic knowledge scale had significant 
higher scale scores on the behavior scale than the students in the comparison group (also abou 
three points on average). We found no significant differences in Belgium (Flemish), Denmark, the 

etherlands, and the Russian Federation. 
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CCS 2016 also used items to measure the importance of personally responsible citizenship 
behavior: (a) “working hard" (ICCS 2016 average percentage of students rating the behavior as quite 
or very important: 8596); (b) “always obeying the law" (quite or very important: 92%); (c) 'ensurin 
the economic welfare of their families" (quite or very important: 94%); (d) “making personal efforts 
to protect natural resources (e.g. through saving water or recycling waste)" (quite or very important: 
8996); (e) “respecting the rights of others to have their own opinions" (quite or very important: 
95%); (f) “supporting people who are worse off than you” (quite or very important: 9596); and 
(g) “engaging in activities to help people in less developed countries" (quite or very important: 81%). 

y 


8 


The resulting scale had good reliability (Cronbach's alpha = 0.78) across participating countries 
and we standardized the scores to give a mean of 50 and a standard deviation of 10 for the equal 
weighted countries (see item map in Figure 5.3, Appendix D). 


Because very large majorities of students across countries rated these behaviors as quite or very 
important, we present only the percentages of students who saw personally responsible behavior 
as "very important” for good citizenship (Table 5.7). Majorities of students viewed the following 
behaviors as very important indicators of being a good citizen: always obeying the law (5996 on 
average), ensuring the economic welfare of their families (6096 on average), and respecting others' 
opinions (6296 on average). Across countries, about half of the students, on average, regarded 
making personal effort to protect natural resources and to help people who are worse off as very 
important. 
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Table 5.5: National average scale scores indicating students perceptions of the importance of social-movement-related 


citizenship 
Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 48 (02 V 46 (0.2) 1.8 (0.5) = 
Bulgaria 53(03) A 54 (0.2) -0.4 (0.5) m | 
Chile 52 (0.2) A 54 (0.2) -2.1 (0.5) CRW 
Chinese Taipei = 2 (OE s 52 (0.2) -0.6 (0.5) E 
Colombia 55 (0.2) A 55 (0.1) -0.2 (0.5) [| 
Croatia 52 (02) A - - E 
Denmark! 44 (0.2) v 44 (0.2) -0.2 (0.5) a 
Dominican Republic 56 (0.2) A 59 (0:3) 2.4 (0.5) m m 
Estonia! 48 (0.3) V 48 (0.2) 0.2 (0.5) nr 
Finland 47(02) v 46 (0.2) 1.3: (0,5) mm 
taly 53 (02) A 52 (0.2) 1.1 (0.5) mu 
Latvia! 48 (02 V 49 (0.2) -1.5 (0.5) ma 
Lithuania 49 (02 V 49 (0.2) 0.0 (0.5) [| 
alta 508102) S 49 (0.3) O.6 (0.6) La 
exico 54 (0.2) A 53 (0.2) 0.9 (0.5) | 
etherlands* 45 (02) y - - Hi 
orway (9) 50 (0.2) V 49 (0.2) 0.6 (0.5) 1 
Peru 5 (02 A - E 
Russian Federation 49 (0.3) V 50 (0.2) -0.9 (0.5) Lm 
Slovenia Ee ffe 48 (0.2) 14 (05) Te 
Sweden 49 (0.3) V 48 (0.2) 1.6 (0.5) m 
ICCS 2016 average 50 (0.0) 
Common countries average 50 (0.0) 50 (0.1) O.3 (0.1) 
Countries not meeting sample participation requirements 
Hong Kong SAR 49 (0.2) - - [| 
Korea, Republic of? 53 (0.3) - - iss 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia! 47 (0.4) - - = 
(Germany) 
lll] 2016 average score +/- Confidence interval 
Wl 200? average score +/- Confidence interval 
On average across items, students with a score in the range with this color 


National average: 


A More than 3 score points above ICCS 20 


A Significantly above ICCS 2016 average 
V Significantly below ICCS 2016 average 


W More than 3 score points below ICCS 20 


Notes: 


() Standard errors appear in parentheses. S 


Met guidelines for sampling participation 


(9) Country deviated from International De 
t 
1 


National Defined Popula 
Country surveyed target 


-  Nocomparable data 


available. 


Across all participating countries, 42 percent of students on average viewed working h 
third across countries shared this view with respect to engagin 
help people in less developed countries (refer to Table 5.7). Perceptions regarding 
haviors varied notably across countries. For examp 
particular, Bulgaria, Chinese Taipei, Croatia, and the Dominican Republic) m 
dered working hard as very important for good citizen 
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Quite or very important 


atistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 
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developed countries were considerably higher among students in the Latin American countries 
(Chile, Colombia, Dominican Republic, Mexico, Peru), but they were lower in Denmark, Estonia, 
Finland, Latvia, and the Netherlands. 


Table 5.8 shows the national average scale scores indicating students' perceptions of the importance 
of personally responsible citizenship behaviors. Chinese Taipei and the Dominican Republic 
recorded the highest national average scale scores (three or more points above the ICCS 2016 
average); Estonia, Latvia, and the Netherlands recorded the lowest national averages. 


Female students scored significantly higher than males (by two scale points on average) on the 
personal responsibility scale in all but one country (refer to Table 5.8). Students who expressed 
interest in political and social issues had consistently higher scale scores than those who expressed 
ittle or no interest. The score difference on average across countries was three scale points. 
Students with higher levels of civic knowledge also had consistently higher scores, indicating that 
they regarded responsible citizenship behavior as more important than the students with lower 
evels of civic knowledge did. We recorded a difference of about three scale score points, on average, 
between the two groups across participating countries. 


Students' attitudes toward equal opportunities 


Positive attitudes toward equal opportunities for all groups within a society, independent of their 
gender or origin, are widely regarded as part of the ideal of a democratic society (Angvik & von 
Borries, 1997; Hahn, 1998). The establishment of equity as a sub-domain (content domain civic 
principles) in the ICCS 2016 assessment framework emphasizes the importance of this aspect 
for civic and citizenship education, as does the inclusion of the sub-domain civic connectedness 
content domain civic identities) in the framework. Connectedness refers to citizens' beliefs about 
tolerance of diversity in society. 


Attitudes toward gender equality have been a focus of IEA research on civic education ever since 
the association conducted its first study in this areain 1971. That study used four items to measure 
support for women's political rights (Torney et al., 1975). In 1999, the CIVED survey captured 
students’ attitudes toward women’s political rights using an extended set of three positively and 
three negatively worded items (Torney-Purta et al., 2001). Female students in that study tended to 
express higher levels of support for gender equality than males did. Using data from CIVED 1999, 
Barber and Torney-Purta (2009) examined gender differences in depth and identified classroom 
practices that tend to reduce the gap between males and females. 


CCS 2009 included seven items on gender rights, some of them identical or similar to those used 
in CIVED. The ICCS 2009 researchers used six of these seven items to derive an IRT-based scale 
reflecting students' attitudes toward gender equality. The 2009 results showed large majorities of 
students across countries agreeing with the positive and disagreeing with the negatively worded 
statements about gender equality (Schulz et al., 2010, pp. 95-98). 


ThelCCS 2016 student questionnaire included the same set of seven items to measure students' 
attitudes toward gender equality. As with the previous survey, we used six of these items to derive a 
S ts’ 


cale reflecting (positive) student attitudes toward gender equality. The items measuring studen 


endorsement of gender equality were (a) “Men and women should have equal opportunities to take 
part in government” (75% of students strongly agreed on average across the ICCS 2016 countries) 
(b) “Men and women should have the same rights in every way" (72% strongly agreed); (c) Women 
should stay out of politics" (5596 strongly disagreed); (d) "When there are not many jobs available, 
men should have more right to a job than women" (5096 strongly disagreed): (e) “Men and women 
should get equal pay when they are doing the same jobs" (71% strongly agreed); and (f) “Men are 
better qualified to be political leaders than women" (46% strongly disagreed). 
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Because the scoring of the negatively worded items was reversed, the higher scale scores on the 
(CCS 2016 endorsement of gender equality scale reflect more positive attitudes toward gender 
equality. The scale was equated to ensure the resulting scale scores could be compared with those 
collected in the 2009 survey. The ICCS 2016 scale had high reliability (Cronbach's alpha = 0.78) 
on average across the participating countries (see item map in Figure 5.4, Appendix D). 


Students in most of the ICCS 2016 countries tended to express strong agreement with positively 
worded statements and strong disagreement with negatively worded statements about gender 
equality, as indicated by the location of their average scores inthe lighter colored area of the graph 
in Table 5.9. This finding aligned with the pattern of corresponding average scores in ICCS 2009. 


The highest scale score averages (that is, three or more points above the international average) 
were recorded in Chinese Taipei, Denmark, Finland, Norway, and Sweden, while the lowest ones 
(three or more points below the international average) were observed in Bulgaria, the Dominican 
Republic, Latvia, Mexico, and the Russian Federation. When we compared the scale scores of the 
CCS 2009 and ICCS 2016 common countries, we recorded statistically significant increases 
across time in eight of those countries: Belgium (Flemish), Denmark, Estonia, Finland, Italy, Malta, 
orway, and Sweden. On average across all participating countries, we observed a statistically 
significant increase of just over one score point. 


n addition to showing comparisons of scale scores across gender groups, and (high and low) levels 
of civic knowledge, Table 5.10 displays scale scores comparing the endorsement of gender equality 
between students with at least one parent with a university degree and students whose parents had 
not reached this level of qualification. The inclusion of these variables in ICCS allowed us to review 
the influence of home educational background on students' perceptions of equal opportunities. 
For all three pairs of comparison groups, we observed consistently significant associations across 
countries. On average across participating countries, females had scale scores about five points 
higher than the males' scores, students with at least one parent with a university degree scored 
bout two points higher than the other students, and those students with civic knowledge at Level 
proficiency or above had scores about eight points higher than those with the lower levels of 
vic knowledge. 


a 
B 
C 


Theseresults confirm findings from earlier studies that female students tend to be more supportive 
of gender equality than males and that students with higher levels of civic knowledge also express 
more positive attitudes. The results furthermore indicate that students with parents with a 
university degree hold more favorable attitudes about equitable rights between females and males. 


Another important aspect of students' regard for equity and tolerance is ethnic and racial 
background. In many countries, surveys of adults show perceptions of persisting high levels of 
ethnicand racial discrimination (Chong & Nopo, 2007; European Commission, 2012; Nopo, Chong, 
& Moro, 2010). Previous IEA studies have included measures of students' attitudes toward equal 
rights and opportunities for all ethnic and racial groups in society: CIVED 1999 measured this 
construct with four items, while ICCS 2009 used five. The items in both studies were used to derive 
a scale reflecting this construct (Schulz et al., 2010; Torney-Purta et al., 2001). 


The ICCS 2016 student questionnaire included the following five ite 
endorsement of equal rights for all ethnic/racial groups in their country: (a) "All «ethnic/racial 
groups» should have an equal chance to get a good education in «country of test>” (62% of students 
strongly agreed on average across participating countries); (b) “All «ethnic/racial groups» should 
have an equal chance to get good jobs in «country of test>” (57% strongly agreed); (c) “Schools 
should teach students to respect «members of all ethnic/racial groups?" (5796 strongly agreed); 
(d) "Members of all ethnic/racial groups should be encouraged to run in elections for political 
office" (31% strongly agreed); and (e) “Members of all ethnic/racial groups should have the same 


ms to measure students' 
tr 
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Table 5.9: National average scale scores indicating students’ endorsement of gender equality 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 54 (03 A 52 (0.3 1.9 (0.6) m 
Bulgaria 46 (03 Y 46 (0.3 0.4 (0.6) [ 
Chile 52 (0.3) A 51 (0.3 1.1 (0.6) E 
Chinese Taipei 56(02 A 55S (Oe 0.9 (0.5) E 
Colombia 50 (03 V 49 (0.2 1.0 (0.6) W 
Croatia 5 (0:9) AX - - im 
Denmark! 56 (0.2) A 54 (0.2 1.9 (0.5) TE 
Dominican Republic 44 (0.2) Y 44 (0.2 O.8 (0.5) E 
Estonia! 51 (0.3) 49 (0.3 1.9 (0.6) Wa 
Finland 55 (0.2) A 5302 1.3 (0.5) mm 
taly 53 (0.2) A 52-102 1.4 (0.5) m 
Latvia! 46 (0.2) VW 46 (0.2 0:5: (0:5) Le 
Lithuania 49 (02 V 48 (0.2 0.7 (0.5) | 
alta 531 (O:2)) TA SS 1.7 (0.5) m 
exico 45 (01) Y 45 (0.1 -0.2 (0.5) H 
etherlands! 59 (08 A - - CH 
orway (9)! 57(02 A 54 (0.3 2.7 (0.5) m 
Peru 49 (03 V - - m 
Russian Federation 44 (0.2) Y 44 (0.1 0.8 (0.5) E 
Slovenia 5° (0 A, 52 02 0.9 (0.5) (e 
Sweden 57 (0.2) A 55 (0.3 1.9 (0.6) mu 
ICCS 2016 average Si (O) 
Common countries average SIRMO SORON 1.2 (0.1) 
Countries not meeting sample participation requirements 
Hong Kong SAR 51 (0.4) = = = 
Korea, Republic of? 53) (03) - - m 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia! 55 (0.9) - - Es 
(Germany) 
ll] 2016 average score +/- Confidence interval 
Wl 200? average score +/- Confidence interval 
On average across items, students with a score in the range with this color 


National average: 

A More ban 3 score points above ICCS 2016 average 
A Significantly above ICCS 2016 average 

V Significantly below ICCS 2016 average 

WY More than 3 score points below ICCS 2016 average 


have more than a 5096 probability of indicating: 


No strong agreement with positive and no strong disagreement 
with negative items 


Strong agreement with positive and strong disagreement with 
negative items 


Notes: 
() Standard errors appear in parentheses. Statistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

T Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 9096 to 95% of National Target Population. 

? Country surveyed target grade in the first half of the school year. 

- No comparable data available. 


rights and responsibilities" (5996 strongly agreed)? Because ICCS 2009 used the same question, 
we were able to derive an equated scale for ICCS 2016 that allowed us to compare the scores on 
the ICCS 2009 and 2016 scales. The 2016 scale had high reliability across countries (Cronbach's 
alpha = 0.82), with the higher scores on it reflecting more positive attitudes toward equal rights 
for all ethnic and racial groups in a country (see item map in Figure 5.5, Appendix D). 


3 Expressions in angle brackets (<>) were adapted to suit the respective national contexts. 
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Of the countries participating in ICCS 2016, Chile, Chin 
highest average scale scores, thus in 
groups. Bulgaria, Latvia, and the Netherlands recorded th 
exception of Bulgaria, all countries that participated in bot 
higher scores— 2.7 scale points on average (equivalent to n 
standard deviation)—in 2016 than 
countries tended to strongly agree with the statements refl 
all ethnic and racial groups (see the 
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ese Taipei, and Sweden recorded 
dicating endorsement of equal rights for all ethnic and 
e lowest scores (Table 5.11). With 
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than a quarter of an internati 
they did in 2009. On average, students in many of the ICCS 
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ighter colored area in the Table 5.11 graph). 


h cyc 
nore 


ectin 


the 
racial 
the 


y 
onal 


for 


Table 5.11: National average scale scores indicating students’ endorsement of equal rights for all ethnic and racial groups 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 50 (0.3 V 48 (0.3) 2.5 (0.5) m 
Bulgaria 49 (0.3 v 48 (0.2) OS (0:4) | 
Chile 57 (0.2 A 54 (0.2) 2.1 (0.4) m gm 
Chinese Taipei 58 (02 A 57 (0.2) 12 (0:3) TR 
Colombia 54 (0.2 A 53 (0.2) 1.0 (0.3) | 
Croatia 52 (02 V - - = 
Denmark! 51 (0.2 V 48 (0.3) 2.7 (0.5) m D 
Dominican Republic 54 (019) A 51 (0.3) 3.1 (0.4) m 
Estonia! 53 (0.2 51 (0.2) 2.1 (0.4) m m 
Finland 53 (02 48 (0.2) 4.9 (0.4) m [ | 
taly 52 (0.2 V 49 (0.2) 2.5 (0.4) m m 
Latvia! 48 (0.2 v 46 (0.2) 1.8 (0.4) B 
Lithuania 53 (0.2) 50 (0.2) 2.8 (0.4) m = 
alta XM (P2) sy 46 (0.3) 4.3 (0.4) Pa L| 
exico 55 (0.2 A 52 (0.2) 2.5 (0.4) m P 
etherlands* 49 (0.3 v - - m 
orway (9)* 55 (0.2 A 51 (0.3) 4.6 (0.5) E E) 
Peru 54 (0.2 A - - [| 
Russian Federation 52 (0.4 V 48 (0.2) 3.6 (0.5) H Œ 
Slovenia 5102 V 49 (0.2) 1.7 (0.4) mm 
Sweden 57 (0.3 A 52 (0.3) 5.4 (0.5) [ss] [ | 
ICCS 2016 average 58 (01 
Common countries average or (COLI 50 (0.1) 2. (9.10) 
Countries not meeting sample participation requirements 
Hong Kong SAR 54 (0.3 - = = 
Korea, Republic of? 56 (0.3 - - m 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 54 (0.4) - - CH 
(Germany)! 
ll 2016 average score +/- Confidence interval 
Wl 2009 average score +/- Confidence interval 
National average: On average across items, students with a score in the range with this color 


A Morethan 3 score points above ICCS 2016 average 


A Significantly above ICCS 2016 average 
V Significantly below ICCS 2016 average 


W More than 3 score points below ICCS 2016 average 


Notes: 


have more than a 50?6 probability of indicating: 


No strong agreement with positive statements 


Strong agreement with positive statements 


() Standard errors appear in parentheses. Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 


(9) 
+ 
1 


Country deviated from International Defined Population and surveyed adjacent upper grade. 
Met guidelines for sampling participation rates only after replacement schools were included. 
National Defined Population covers 90% to 95% of National Target Population. 


Country surveyed target grade in the first half of the school year. 


- No comparable data available. 
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In all except two ICCS 2016 countries, female students tended to hold more positive attitudes 
than males toward equal rights for all ethnic and racial groups: on average, there was a difference 
of about two score points between the two groups (Table 5.12). In all but ive countries, students 
with at least one parent with a university degree were also somewhat more likely to endorse equal 
opportunities than their peers who did not have a parent with a university degree. We recorded an 
average difference of about two scale score points between these two groups. In all participating 
countries, students with higher levels of civic knowledge also scored significantly higher than the 
students with lower levels of civic knowledge. On average, the difference was about five score 
points (equivalent to about half a standard deviation). 


Students' perceptions of global issues, trust in institutions, and 
attitudes toward the influence of religion in society 


Increasingly, worldwide, the potential impact of human activity on the environment and future 
global development has become a key issue in debates about future political, social, and economic 
development. In this context, responsible citizenship is increasingly viewed as including awareness 
of and regard for sustainable development. Over the years, scholars have amassed evidence 
of growing concern among young people about global issues, including poverty, hunger, wars, 
overpopulation, and the environment (see, for example, Holden, 2007; Oscarsson, 1996; Rubin, 
2002). Inclusion of these global aspects in learning related to civic and citizenship educationis part 
of a number of initiatives aimed at broadening students' perspectives beyond national contexts 
(Burnouf, 2004; Hicks, 2003; UNESCO, 2015). The ICCS research team therefore considered 
students' perceptions and awareness of issues related to global citizenship and sustainable 
development as an important aspect for inclusion in the 2016 survey (Schulz et al., 2016). 


In order to measure students' awareness of and concern about global issues, the ICCS 2016 
student questionnaire asked students to consider the seriousness of a broad range of issues faced 
by nations across the world by indicating the extent to which they regarded each one as a threat 
("to a large extent,’ “to a moderate extent; “to a small extent; "not at all"). The issues included 
pollution, energy shortages, global financial crises, crime, water shortages, violent conflicts, poverty, 
food shortages, climate change, unemployment, overpopulation, infectious diseases (e.g., bird flu, 
AIDS), and terrorism. 


Table 5.13 shows those issues, which more than half of the students, on average, rated as a large 
threat to the world's future. The inter-country range displayed below the average international 
percentages of students rating each issue as a global threat indicates the differences between the 
highest and lowest national percentages. 


About three-quarters (cross-national average) of the ICCS 2016 students saw pollution as a large 
threat; Chile, Colombia, and Lithuania recorded the highest proportions. Approximately three- 
quarters of students across the participating countries viewed terrorism as an important threat, 
but we recorded some notable variations among the countries. While more than three quarters 
of students in Croatia, Latvia, Lithuania, Malta, and the Russian Federation thought terrorism an 

a 

e 


important threat, just over half of the students in the Dominican Republic, the Netherlands, Norway, 
and Sweden shared this perception. Almost two-thirds of students across the ICCS countries saw 
water shortages as an important global threat. However, the national average percentages varied 
considerably—from over 80 percent of students in Chile and Colombia to less than half of the 
students in Finland, the Netherlands, Norway, and Sweden. 


Food shortages were perceived as an important global threat by 62 percent of the lower-secondary 
students across the ICCS 2016 countries. We recorded particularly high percentages (above 8096) 
in Chile and Colombia, but much lower ones in Nordic countries such as Finland and Sweden (below 
50%). Infectious diseases (e.g., AIDS or bird flu), climate change, and poverty posed important global 
threats for more than half of the participating students on average. Considerable cross-country 
variation was evident for all three of these global issues. Also, whereas in some developed countries 
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BECOMING CITIZENS IN A CHANGING WORLD 


ch as Denmark, Finland, Norway, and Sweden), students saw infectious diseases and poverty 
as lesser global threats, their rating of the threat posed by climate change was much higher than 
average. These perceptions might reflect higher health standards in these countries as well as 


iewed it as a large threat to th 
igh levels on indicators of cri 
haracterized 


variations, which were probab 
46 percent of students on average across the ICCS 2016 countries viewed this form of conflict 
as an important global threat. About half or more of the students in many countries regarded this 


issue as important, but less than a third did so in Finland, the Netherlands, and Norway. 


Less than half o 


crisis (44%), 


Taken togeth 


cern were 50 percent and under. About hal 
rime as a threat to the world 


ure to discussions about the effects of climate change on the world’s future. 


dents in the ICCS 2016 countries saw the issues in Table 5.14 of lesser concern 
cted in Table 5.13. On average, the percentages of students who rated these 


£ 


of the students, on average, regarded 
's future. Once again, we observed considerable variations in the 


percentages of students across countries: although 60 percent or more saw crime as an important 
global threat in Chile, Colomb 
of young people in Belgium (F 
V 
h 
C 


ia, Mexico, Peru, and the Russian Federation, no more than a third 
emish), Denmark, Finland, the Netherlands, Norway, and Sweden 
e world's future. Countries in the first group tend to have relatively 
me such as homicide statistics, while those in the latter group are 


by relatively low values on these indicators (see UNODC, 2014). We observed similar 


y influenced by local contexts, for violent conflict as a global threat; 


f the surveyed students across the ICCS 2016 countries regarded the global financial 


energy shortages (43%), unemployment (41%), and overpopulation (39%) as global 
threats. Notable between-cou 
ranging from 30 percent (Finland) to 63 (Chile) for energy shortages; from 26 (Denmark) to 58 
(Bulgaria) fo 


r unemployment; 


er, the findings (su 


ntry variation was obvious for all of these issues, with percentages 


and from 27 (Finland) to 53 (Chile) for overpopulation. 


mmarized in Tables 5.13 and 5.14) suggest that student perceptions 


of global threats are often influenced by local contexts (regarding crime or global financial crises, 


for 
stu 
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climate chan 
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inv 


decades 


Studying young people's trust 
education since the association's first study in this area. That study included an item on trust in 
(Torneyetal., 1975). The CIVED study in 1999 used aset of 12 items covering political/ 
tions, media, United Nations, schools, and people in general. The first ICCS survey in 
| 1 core items in a modified format augmented by three optional items 
ns and state/provincial institutions. Across countries, the results showed 


government 
civic institu 
2009 used a similar range of 1 
European institutio 


on 
stu 
tru 
(Sc 


example 
dents ten 
dents in d 


ge and terrorism, 


explained in the ICCS 201 


that emphasize their importance. While in the developing countries majorities of 
ded to perceive issues such as poverty or violent conflict as global concerns, fewer 
eveloped European countries shared this view. For some of the other issues, notably 


the student-perception patterns were less obvious. 


6 assessment framework, one important aim of the study was to 


estigate the attitudes students hold toward civic institutions in their countries. Over past 


dents ten 


many scho 


st for courts of justice, but 
hulz et al., 2010, pp. 103-109). Further research using ICCS 2009 data (Lauglo, 2013) showed 


ars have studied and published findings pertaining to people's trust in civic 
institutions. Survey data in particular suggest a gradual decline in trust among adults throughout 
this period (Newton & Norris, 2000; Torcal & Montero, 2006). Research conducted during the 
past decade provides some evidence that economic crises have been responsible for decreasing 
levels of trust among citizens (Muro & Vidal, 2017). 


ninstitutions has been part of IEA research on civic and citizenship 


ding to express the lowest levels of trust in political parties and the highest levels of 


there was considerable cross-national variation in these findings 


that in countries with higher levels of perceived corruption as well as low scores on indices of 
government efficiency, students with higher levels of civic knowledge expressed less trust in civic 
institutions. However, the same study found positive correlations between civic knowledge and 


trust in countries with 


ow indi 


ices of perceived corruption. 
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Table 5.14: Students' perceptions of threats to the world's future 
Percentages of students viewing as threats to the world's future: 
Country Crime Violent conflict | Global financial Energy Unemployment | Overpopulation 
crises shortages 
Belgium (Flemish) 32 (11) v 36(13) Y 42 (1.3) V 39 (12) V 33 (11) V 50 (13) A 
Bulgaria 60 (1.3) A 48 (1.2) S (S) NA 44 (1.2) 53 (12)A 39 (15 
Chile 75 (0.8) A 67 (08) A 59 (0.9) A 63 (09) A 58 (09) A 53 (0.8) A 
Chinese Taipei 56 (0.9) A 50 (09) A 48 (1.0) A 60 (0.8) A 40 (0.9) SIRO 
Colombia 70 (1.0) À 68 (0.8) A 61 (09) A 61 (07) A 55 (08) A 47 (10) A 
Croatia SORIA 48 (1.0) 55 (10) A ASENTA 57 (10)A 29010) Y 
Denmark! 30 (08) Y 27(07) Y 33 (08) Y 35 (0.7) V 26 (0.7) Y 39 (0.8 
Dominican Republic (r) 55 (TOTA SANTOT 55 (10) A 54 (TO A E GOD JAN 42 (0.9) A 
Estonia! 51 (1.3 44 (12) V 26 (10) Y 29 (10) Y 36 (11) V 39 (1.1 
Finland 27 (0.7) Y 28 (0.8) Y 32 (0.9) v 27 (0.9) w 30 (0.8) Y 27 (11 > / 
taly 55 (1.0) A 55 (1.0) A 51 (0.9) A 49 (1.1) A 45 (1.0) A 31 (1.0) A 
Latvia! 49 (1.4 SE 44 (1.2) 42 (1.0) 44 (1.1) ^ 40 (1.2 
Lithuania 57 (12) ^ 63 (1.1) A 48 (1.3) A 52 (14) A 41 (1.2) 37 (1.2) V 
alta 53 (0.9) A 51/05 42 (0.8) V 43 (1.0) 34 (08) V ABT (OI) mA 
exico 65 (0.9) A 57 (0.8) A 55 (07) A 51 (08) ^ 56 (0.9) A 52 (10) A 
etherlands' 25 (10) v 27 (0.8) wv 32 (10) Vy Se 27 (ET Ew. QUANT SA 
orway (9)* 33 (08) Y 32(07 Y 38 (0.7) V 28 (0.7) Y 28 (0.7) Y 37 (0.9) V 
Peru 64 (1.1) À 49 (1.0) A 37 (0:8) VW SE AGLI) AVA 28 (0.7) v 33 (10) 
Russian Federation 61 (09) A 49 (1.1) A 43 (1.0) 36 (0.9 V 41 (1.0) 30 0) V 
Slovenia 57 (LO) eA 22 (15 GY; AY (10 A 43 (0.8) 55 (1.1) £ 44 (0.9) A 
Sweden: 28 (0.9) Y 34(12) Y 31 (0.9) Y 30 (10) Y 27 (1.1) Y 41 (1.1 
ICCS 2016 average 50 (0.2 46 (0.2) 44 (0.2) 43 (0.2) ZU) 39 (0.2 
Inter-country range 50 An 36 36 32 26 
Countries not meeting sample participation requirements 
Hong Kong SAR 50 (1.1) 52 (0.9) 40 (1.1) 77 (1.3) 36 (1.1) 49 (1.0) 
Korea, Republic of? 56 (1.2) 47 (1.1) S72) 60 (1.3) 54 (1.4) 22 (10) 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphaliat AB (15) 38 (1.4) 28982) SEN SE 539 (15) 
(Germany) 


National percentage: 

A More than 10 percentage or 3 score points above average 

A Significantly above ICCS 2016 average 

V Significantly below ICCS 2016 average 

W More than 10 percentage points or 3 score points below average 


Notes: 

() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

+ Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 90% to 95% of National Target Population. 

2 Country surveyed target grade in the first half of the school year. 

An “(r)” indicates that data are available for at least 70% but less than 85% of students. 


(CCS 2016 used the same item set as in ICCS 2009 to measure student trust. The items asked 
students to use the following rating scale—‘completely,’ “quite a lot; “a little; or “not at all'—to 
express their level of confidence in institutions, groups, and sources of information. Given the 
increased importance of new forms of social media in young people's engagement with political and 
social issues (Kahne, Middaugh, & Allen, 2014), social media was added to the list of institutions 


and groups cited in the items used to assess students' trust in civic institutions. 


n 


Table 5.15 shows the percentages of students' expressing quite a lot or complete trust in their 
national government, national parliament, and courts of justice in 2016. These institutions 
represent the three powers in a democracy—executive, legislative, and judiciary. On average across 
countries, almost two thirds of students expressed trust in their governments; the proportions 
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were slightly lower for the national parliament and highest for courts of justice. Countries where 
more than two thirds of the ICCS 2016 young people showed confidence in all three institutions 
included Belgium (Flemish), Denmark, Norway, the Russian Federation, and Sweden. Particularly 
Ow levels of trust across all three institutions were recorded in Chile, Colombia, and Peru, a finding 
commensurate with findings from adult surveys showing relatively low trust in civic institutions in 
the Latin American region (Valenzuela, Schwartzman, Biehl, & Valenzuela, 2008). 


any of the ICCS 2016 countries that also participated in ICCS 2009 and for which data were 
comparable recorded increases in the percentages of students expressing trust in civic institutions, 
in particular for trust in national governments and parliaments in Belgium (Flemish), Chinese 
Taipei, Latvia, and Lithuania (Table 5.15). Statistically significant decreases in trust in government 
were recorded for all three institutions in Chile, for government and parliament in Italy, and for 
government in Colombia and Slovenia. 


These changes in students' confidence in institutions may have been affected by particular 
circumstances in each country at the time of each survey. In line with the observations of Muro 
and Vidal (2017) regarding opinion polls among adults, the global financial crisis of 2007/2008 
may have negatively affected the level of trust in institutions measured among young people 
during the ICCS 2009 survey, while (at least in some countries) threats of terror and government 
reactions may have led to higher levels of confidence among adolescents. However, it needs to 
be acknowledged that these explanations are only tentative ones and that the notable changes 
sincethe last ICCS survey deserve further exploration, in particular with regard to specific national 
factors that might provide further or alternative explanations. 


Table 5.16 shows the percentages of students expressing complete or quite a lot of trust in 
political parties, people in general, "traditional" media (television, newspapers, radio), and social 
media. As in ICCS 2009, young people in 2016 tended to express relatively lower levels of trust 
in political parties. On average across the ICCS 2016 countries, less than 50 percent of students 
indicated quite a lot or complete confidence in this institution. However, in nine countries, average 
percentages of trust were significantly higher than in the previous survey, with increases above 
10 percentage points in Belgium (Flemish), Chinese Taipei, Latvia, and Lithuania. Trust in political 
parties among lower-secondary students decreased significantly in Colombia, Denmark, Italy, 
and Malta. 


On average, 53 percent of the 2016 students expressed trust in people in general. However, 
a comparison of the results for this item in the common ICCS countries showed a slight but 
statistically significant dip in confidence between 2009 and 2016 (Table 5.16). A drop in trust 
across the two cycles was also evident in six countries with respect to traditional media, even 
though more than half of the 2016 students expressed trust in those media. The largest decreases 
intrust in traditional media occurred in Chile and Latvia. Forty-five percent of students on average 
internationally expressed quite alot or complete trust in social media. However, percentages varied 
to a relatively large extent across countries: whereas in Bulgaria, the Dominican Republic, and 

alta, 60 percent or more of the surveyed students had confidence in this source of information, 
ess than a third shared this confidence in Belgium (Flemish), Denmark, Estonia, the Netherlands, 
orway, and Sweden. 


As in ICCS 2009, we used six items (national government, local government, national parliament, 
police, courts of justice, political parties) to derive a scale reflecting students' trust in civic 
institutions. This IRT scale had high reliability across countries (Cronbach's Alpha = 0.85), and we 
equated it with the scale used in ICCS 2009 so that we could compare the scale scores across the 
two cycles (see item map in Figure 5.6, Appendix D). Because students are most likely to obtain 
information about institutions, media, and civic groups from media, we compared the scale scores 
of students' trust in civic institutions by categories of students who said they informed themselves 
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about social and political issues at least weekly from television news, newspapers, and/or the 
nternet. We also added to our comparison the variables of parental educational attainment and 
civic knowledge (see Table 5.17). 


The comparison results showed that, in most ICCS 2016 countries, students who were using 
media to obtain information about political and social issues tended to have (significantly) 


higher levels of trust; on average, the scale score difference was about two points. The positive 
associations between trust in civic institutions and use of media for information does not support 
suggestions about negative effects of media news (often called "video malaise") on perceptions of 
institutions that some scholars have postulated (see, for example, Mutz & Reeves, 2005). Rather, 
the associations align with research which identifies media information as a source that fosters 
trust in institutions (see Avery, 2009; Norris, 2000). 


The 2016 students with at least one parent with a university degree expressed slightly more trust 
than the comparison group in civic institutions in seven countries—Belgium (Flemish), Denmark, 
Estonia, Finland, the Netherlands, Norway, and Sweden. The reverse pattern was evident in 
eight countries (Bulgaria, Croatia, Dominican Republic, Lithuania, Malta, Mexico, Peru, Russian 
Federation), meaning that students with a parent with a degree had lower average scores. These 
results suggest that in developed countries with a longer tradition of democratic institutions, 
parental education tends to have (weak) positive associations with adolescents' trust in institutions, 
while the reverse applies in those countries with less recently established democratic institutions. 


Students with higher levels of civic knowledge had the lower levels of trust in civic institutions in 
Bulgaria, Chile, Colombia, Croatia, the Dominican Republic, Lithuania, Mexico, Peru, and the Russian 
Federation. In contrast, students with higher levels of civic knowledge expressed (significantly) 
more confidence in civic institutions in Denmark, Estonia, Finland, the Netherlands, Norway, 
Slovenia, and Sweden. These findings are similar to those from previous research, where positive 
correlations between trust and civic knowledge were found in those countries with generally lower 
evels of perceived corruption as well as higher levels of government efficiency (Lauglo, 2013). 


any scholars view religion as an important catalyst of civic participation (see, for example, 
Pancer, 2015; Putnam & Campbell, 2010; Verba, Schlozman, & Brady, 1995). Based on findings 
from research conducted in the United States and Canada, Smidt (1999) concluded that religious 
traditions and church attendance are associated with civic participation, an association that 
fi 
S 


remained significant after Smidt controlled for other factors. Storm (2015) reported similar findings 
for the United Kingdom. The ICCS 2009 student questionnaire asked students questions about 
their religious denomination and attendance at religious services. The questionnaire also included 
six items designed to measure students’ attitudes toward the influence of religion in society. The 
results showed that in most countries the students who attended religious services held more 
positive attitudes toward religion having an influence in society (Schulz et al., 2010, pp. 107-113). 


(CCS 2016 included the same set of questions as part of an international option. Twenty of 
the 24 countries chose to include this option. The same five ICCS 2009 items used to measure 
students' attitudes toward the influence of religion on society were included in this survey: (a) 
“Religion is more important to me than what is happening in national politics" (ICCS 2016 average 
percentage of students agreeing with this statement: 4296); (b) “Religion helps me to decide what 
isright and what is wrong" (4896 agreed); (c) "Religious leaders should have more power in society" 
(2996 agreed); (d) "Religion should influence people's behavior towards others" (5196 agreed); 
and (e) “Rules of life based on religion are more important than civil laws" (3296 agreed). ICCS 
2016 added two further items, one of which— Religious people are better citizens —was used as 
an additional item (3296 agreed) to derive a scale reflecting students' endorsement of religion's 
influence in society. The IRT scale had high reliability across participating countries (Cronbach's 
alpha = 0.87), and we equated it to the ICCS 2009 scale so that we could compare scale scores 
across the cycles (see item map in Figure 5.7, Appendix D). 


BECOMING CITIZENS INA CHANGING WORLD 


138 


`gƏÁ |OOuDS au JO Jey IS 94} ur əpei8 3984e3 Däin e AjjunO z 

"uonejndog 3984e| |EUOIEN JO 9666 019606 S419402 uolye|ndog peugeg IEUOEN q 

"pepnjoui aan, sjoouos 3uauueoe|deJ Jaye Ajuo se3e4 uonedionaed 8ul|duies J04 seulepin8 join) 4 
‘apess Jaddn 3uaoefpe poAo^uns pue uone[ndog pauyag |euoleuJəlu| Woy po3el^ep AJuno? (6) 


‘Plog u! pade|dsip ase dnoJ8 uosiJeduuoo au) ur Əsoy} uey} (GOQ'O > d) 4984| AjJUeDYIUBIS de Jey} se8eJo^e 34025 
'sosoujuaJed ul Jeadde s40449 puepueys () 
:SƏJON 
"CO > dye 3ue»yiugis Á||e211si1e1s JOU sdnoi8 uosiuieduio5 UdaMjaq 32u243JJIQ 
`GO'0 > d 3e que»uiugis Ajjeonse1s sdnoJs uosiieduioo uəəwqəq ə2uəJ1əJiq ` 
(EO) 6v ] (o) OS (E'O) OG (S'0) ét (go) os m (SO) 6v ;Joiqndeg| 'esJo 
(EO) TS E (sO) OS (S'O) ZS a (gO) TS (go) TS m (SO) OS avs BUOJ SUO} 
sjuawasinbas uonedioned ajdwes 8uljaaw 1ou səluqunoo 
(LO) TS B (LO) TS (IO) TS | (LO) IS (TO) Z = (LO) OS Spa 9102 SH 
(€O) vS m (90) ¿S (€o) rS =m (o) £S (CO) vS =s (90) ¿S ;U9paMS 
(£O) OS iml (SO) 8v (€o) OS (£0) 6v (£O) OS im (O) 8! EIUSAO|S 
(go) £S m (SO) vS (€o) £S m (go) £S (£0) vS = (çO) TS uolłeJopə4 UEISSNY 
(£0) Sv === (go) OS (v0) Zt m (cO) 8v (cO) 8t (90) 87 nied 
(cO) SS =i (90) €S (CO) SS Ei (CO) re (CO) 9S = (CO) €S 1(6) Aemuo 
(go) £S m (%0) 2S (go) £S ul (o) cS (£0) €S [] (v0) ¿S 1Spuej19u1S 
(€o) 8v == (€0) ¿S (go) 8t [s] (€o) OS (CO) OS = (VO) 6i oro 
(cO) cS Ü (es (£O) TS imi (cO) £S COLS Ë= (r0) OS eje 
(gO) cS ES (FO) vS (go) ¿S m (CO) £S (CO) £S == (r0) TS eiuenur] 
(€O) 6v (FO) 6i (€o) 6v (€o) 6v (go) OS = (£0) 8r TEE] 
(cO) TS (FO) TS (go) ¿S (cO) TS (CO) TS Em (€o) OS Ale} 
(€o) SS Pai (90) cS (go) SS m (£0) 7S (£O) SS m (€O) vS pue|urj 
(CO) TS = (SO) 6v (€O) TS m (£0) TS (CO) TS m (€'O) OS ;E1u0157 
(90) 6v = (go) 9S (SO) bp = (go) 9S (€O) SS i= (SO) tS oiqndes ueorumuod] 
(cO) £S sa (SO) OS (EO) tS m (CO) £S (CO) £S E (CO) cS plewusq 
(€o) 8v E (9'O) OS (v0) Zt ini (€O) 6v (£O) 6v = (pO) Zi eHeo4» 
(€o) Lr = (€o) OS (go) 8v (0) 8! (£0) 6v = (SO) 9v eIquio[o? 
(CO) TS LU (90) cS CO TS (cO) cS (CO) ¿S (SO) TS det asaulyD 
(€O) 9v = (FO) 8t (0) Zt (go) Ap (€o) 87 = (SO) St SR 
(€o) 8v a IO cS (v0) 8! Pa (O) TS (£'O) OS = (90) 6v euesing 
(CO) €S L (sO) €S (CO) rS E (go) £S (CO) vS | (go) ¿S (usluuə|gq) uuniS[eg 
0 9 © Co 6 & ow ow Gc 3 G Go € © & 9? G 
(əAoqe pue 677) (64:p Mojaq) 99J82p A3isJoAIun 


g |9^91 9^oqe 40 
eSpe|wou» 3IAIO 


Dp 0000 


eSpe| Mou» IAID 


yum Juaied Fo "TTT 99J83p Aysuaaiun 


Əuo1seə|1V UUM Juated oN 


99M e IUO <> 89M e IUO 


ueu aow uet sse] 


38P2|MOU 2IAID JO |ƏAƏ| Aq 98eJo^e 34025 3|e2S 


Əə418əp Ayssaaiun jeyuased Aq 3402s ə|e5S 


uoneunojur eIpəui sjuepnis Aq aBesaAe 3409S ə|e35S 


AJ1uno5 


a5po|MoU» 2IAID Jo [342] PUD *'uoijponpe |bqua4bd 'uorpuuoJui Dia) Aq suomnjrgsul 3IAI9 ur Ten ,sjuapnjs Sumborpul sa102s ais ƏPDIJƏAD [DUONON :/ T G ant 


STUDENTS’ ATTITUDES TOWARD IMPORTANT ISSUES IN SOCIETY 139 


ThelCCS 2016 countries where students were most likely to agree, on average, with the statements 
endorsing the influence of religion in society were Croatia, Colombia, the Dominican Republic, 
alta, and Peru. Those countries where students were least likely to agree with the statements 
measuring this construct were Belgium (Flemish), Denmark, Estonia, the Netherlands, and Sweden 
see Table 5.18). Four of the 12 countries that participated in this option in both surveys (Chile, 
Latvia, Malta, and Sweden) recorded average scores in 2016that were significantly lower than those 
observed in ICCS 2009. Students from the Dominican Republic, however, recorded significantly 
higher scores in the 2016 than in the 2009 survey. Across (common) participating countries, the 
CCS 2016 average scale score was O.8 points lower than in ICCS 2009. 


Table 5.19 shows national scale scores reflecting positive attitudes toward the influence of religion 
in society across the three comparison variables—attendance at religious services, parental 
education, and civic knowledge. In 14 of the 17 ICCS 2016 countries, students reporting (at least 
monthly) attendance at religious services had the higher scale scores on average; their scores were 
about six score points above the average for students who said they either did not or only rarely 
attended religious services. The differences were all significant. The three countries that recorded 
no significant differences between these two groups were Denmark, the Dominican Republic, and 
Sweden. The results indicate that engaging with a particular religion tends to increase support for 
religion having a role in society. 


Students with at least one parent with a university degree held somewhat less positive attitudes 
toward religious influence in society, with statistically significant differences recorded in most 
countries. On average, there was a difference of about two score points across countries. Students 
with a higher level of civic knowledge (that is, at or above Level B) had significantly lower scale 
scores in all participating countries. Cross-nationally, the scale score of students with a higher level 
of civic knowledge was about five points lower than the score for of students with a higher level of 
civic knowledge. These associations suggest that influences from parents with higher educational 
levels and that higher levels of (student) civic knowledge lead to views that tend to be critical of 
the influence of religion on society. 
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Table 5.18: National average scale scores indicating students' endorsement of religious influence in society 


Country National average scale scores for students' endorsement of religious influence in society 
2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 45(03 Y 45 (02) -03 (04 3 
Bulgaria SA (Os) TA 51103) 0.2 (0.4 a 
Chile 49 (0.2) 53 (0.2) -4.0 (0.3 im m 
Chinese Taipei 48 (02 V 48 (0.2) -0.4 (0.3 B | 
Colombia 55(02 A 54 (0.1) 0.3 (0.3 a 
Croatia SS O3) T A m 
Denmark! 43(02 Y 0.2) -0.4 (0.3 r 
Dominican Republic (r) 60 (0.2) A 58 (0.2) 1.5 (@3 m 
Estonia! 44(03 v [ | 
Latvia 46 (03 V 47 (0.3) -1.4 (0.4 m | 
Lithuania 48 (0.2) 49 (0.2) -0.1 (0.3) iul 
alta 54(02 A 55 (02) -1.7 (0.3 EN 
etherlands'! 44 (04) vw - - L em 
orway (9)! 44 (0.3) v 45 (0.4) -0.8 (0.5 Lm 
Peru 56 (01 A - - m 
Slovenia 48 (0.3) V - - ia 
Sweden! 42 (04) YV 44 (0.2) -2.9 (0.5 5E; HM 
ICCS 2016 average 49 (0.1) 
Common countries average 49 (0.1) 50 (0.1) -0.8 (0.1 
Countries not meeting sample participation requirements 
Hong Kong SAR 47 (0.3) - = = 
Korea, Republic of? 42 (0.2) - - E) 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 46 (0.5) - - Co 
(Germany): 
lll 2016 average score +/- Confidence interval 
Il] 2009 average score +/- Confidence interval 
National average: On average across items, students with a score in the range with this color 
A More than 3 score points above ICCS 2016 average have more than a 50% probability of indicating: 
A Significantly above ICCS 2016 average Disagreement with positive statements 
V Significantly below ICCS 2016 average Agreement with positive statements 


W More than 3 score points below ICCS 2016 average 


Notes: 

() Standard errors appear in parentheses. Statistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

t+ Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 9096 to 95% of National Target Population. 

? Country surveyed target grade in the first half of the school year. 

- No comparable data available. 

An “(r)” indicates that data are available for at least 7096 but less than 8596 of students. 
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| updates | 


School contexts for civic and citizenship 


education 


Chapter highlights 


Students and teachers were actively participating in school life. 


e |n most of the ICCS 2016 participating countries, students had participated in classroom 


and school elections. (Table 6.1) 


e The opportunities students had to actively participate in deci 
schools differed across countries. (Table 6.2) 


sions about their respective 


e Teachers were actively involved in decision-making processes. (Table 6.2) 


e Although parents were involved in discussion about students’ learning achievement, their 
broader involvement in decision-making processes was not substantial. (Table 6.2) 


Schools were paying attention to social interactions. 


e Students in the participating countries were positive about classroom climates that are 


open. (Table 6.3) 


e Students interest in social and political issues, their expected 


level of education, and their 


civic knowledge were positively associated with this perception. (Table 6.4) 


e Verbal bullying was taking place in most of the participating countries, but principals and 


teachers had adopted initiatives to counter various forms of b 
Os), FO MO, O LA) 


Schools were interacting with the local community when develo 


e Target-grade students had opportunity to participate in civic 
schools carried out in the local community. (Tables 6.12, 6.13 


Schools had developed activities related to environmental sustai 


e Most of the schools in the participating countries had develo 


ullying at school. (Tables 6.7, 


ping civic-related activities. 


-related activities that their 


nability. 


ped at least some initiatives 


related to environmental sustainability, such as differential waste collection, recycling and 


waste reduction, and energy saving. (Table 6.14) 


e According to teachers, the target-grade students were participating in activities pertaining 


to the environment mainly inside their schools. (Table 6.15) 


Countries differed in relation to civic learning processes and activities at school and in relation 


to teachers' preparedness for teaching civic-related topics. 


e Students civiclearning at school was positively associated with students interest in social 


and political issues, the level of education they expected to atta 
(Tables 6.16, 6.17) 


in, andtheir civic knowledge. 


e Civic and citizenship teaching and learning activities in classrooms varied considerably 


across countries. (Table 6.18) 


e Teachers of subjects related to civic and citizenship educati 
variety of topics and skills. (Table 6.19) 


on felt prepared to teach a 


O International Association for the Evaluation of Educational Achievement (IEA) 2018 


W. Schulz et al., Becoming Citizens in a Changing World, 
https://doi.org/10.1007/978-3-319-73963-2 6 


146 


BECOMING CITIZENS INA CHANGING WORLD 


Conceptual background and prior research 


ThelCCS 2016 assessment framework (Schulz, Ainley, Fraillon, Losito, & Agrusti, 2016) identified 
several contexts that have the potential to influence not only students' learning outcomes in the 
field of civic and citizenship education but also their civic engagement. These contexts include the 
wider community, the school and classroom, the home and peer environment, and characteristics 
of individual students. 


In this chapter, we explore aspects of the ICCS 2016 school and classroom contexts and their 


association with the 


participating students’ learning experience. The chapter addresses ICCS 2016 


Research Question 5: How are schools in the participating countries organized with regard to civic and 


citizenship education 
chapter focuses on 


e [owhatextent do schools in 


facilitate civic 


e Towhat extent do schools an 


learning? 


It provid 
of these aspects i 


development of 
framework poin 


also Ainley, Schu 


civic engagemen 


curriculum, and/or program con 


their atti 


earning that occur throu 


engagement? 


d communities interact to foster students’ civic engagement 


and what is its association with students’ learning outcomes? In particular, the 
the following specific research questions: 


participating countries have participatory processes in place that 


and 


Some aspects related to this general research question were discussed in Chapter 2 of this report. 
ided information about contexts for civic and civic education at the national level. Examples 


nclude the ICCS countries’ general approaches to civic and citizenship education, 


f the role of civic and citizenship education. 


earning proces 


Iz, and Friedman, 2013; 


Losito, 2010). Research also stresses the 


t (Scheerens, 2009). Stud 


climate of the sc 


hool and classroom, and 


teachers and among students are also of vi 


2007; Trafford, 2003). 


ses but also of s 


Eurydice, 2005, 
importance of in 


nkeeping with ICCS 2009, ICCS 2016 considered students’ civic lear 
of not only teaching and 
their schools. What students experience daily at school is deemed of particular relevance for the 
tudes and dispositions. As the a 
ted out, a large number of countries emp 
gh participation and engageme 


tudents’ m 


uthors of t 
hasize the 
nt or socia 
2012; Sch 
formal lear 


tent structure and delivery, and schools’ and teachers’ perceptions 
o Theresults presented inthis sixth chapter of the ICCS 
2016 international report draw on data from the school, teacher, and student questionnaires. 


ning outcomes as the result 
ore general experiences in 


he ICCS 2016 assessment 
non-formal aspects of civic 
interaction at school (see 
ulz, Ainley, Fraillon, Kerr, & 
ning at school for students' 


ents' participation at the school level, the interpersonal 
the quality of the relationships between students and 
tal importance (Backman & Trafford, 2007; Huddleston, 


Participatory processes and social interactions at school 


The 


CCS 2016 school questionnaire included a question on students’ participation in class- 


representative elections and school elections (e.g., for student council/parliament). This question 


was included in both CIVED and ICCS 2009. In the current study, principals were asked to indicate 
how many of the target-grade students participate in these elections (“all or nearly all” “most of 


them; 


"some of them; "none or hardly any"). The response categories for this question also included 


a "not applicable" option so that we could take into consideration different school regulations 
relating to this type of participation in the ICCS 2016 countries. 


In almost all countries, the percentages of students in schools where principals reported a high 
level of participation (“all or nearly all’/“most of them") in elections for class representatives 
were higher than 80 percent; in several countries, percentages were as high as 95 percent (see 
Table 6.1). Only five countries recorded percentages lower than 80 percent— Belgium (Flemish), 
73 percent; Bulgaria, 68 percent; Estonia, 76 percent; Italy, 22 percent; and the Netherlands, 
46 percent. Theresults for students' participation in school elections showed a somewhat greater 
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variation across countries, with 10 countries recording percentages lower than 80 percent: Belgium 
(Flemish), Bulgaria, Chinese Taipei, Estonia, Italy, Latvia, Lithuania, the Netherlands, the Russian 
Federation, and Sweden. 


These findings are relatively consistent with the answers students gave to the question included 
in the student questionnaire on their participation in civic activities at school. On average, 77 
percent of students across countries said they had voted in class or school elections. The national 
percentages ranged from 50 to 93 percent; four countries recorded percentages of 90 percent 
or greater, and three countries recorded percentages under 60 percent (see also Chapter 4 of 
this report). 


Students’ teachers, and parents’ participation in school decision-making processes can be regarded 
not only as a part of democratic governance processes at school but also as a factor characteristic 
of schools that have a democratic learning environment (Torrance, 2013). The different strategies 
and procedures that principals adopt when exercising their role may also have an impact on 
school climate and culture (Edmonds, 1979; Eurydice, 2013; Ishimaru, 2013; Marzano, 2003; 
Sammons, Gu, Day, & Ko, 2011; Scheerens, Glas, & Thomas, 2003). Teachers who participate in 
school governance can contribute to a better understanding of different student learning needs 
and improve their own commitment to supporting school educational activities (Ranson, Farrell, 
Peim, & Smith, 2005). 


The ICCS 2016 school questionnaire asked principals about the extent to which teachers, parents, 


DÉI 


and students engaged in various school processes (“to a large extent,’ “to a moderate extent,’ "to 
a small extent,’ “not at all"). The processes covered in the question were denoted by the following 
statements: (a) "Teachers are involved in decision-making processes;" (b) "Parents are involved 
in decision-making processes;” (c) “Students’ opinions are taken into account in decision-making 
processes;” (d) “Rules and regulations are followed by teaching and non-teaching staff, students, 
and parents;" (e) "Students are given the opportunity to actively participate in school decisions; 


and (f) "Parents are provided with information on the school and student performance” 


Across countries, the highest national percentages of students in schools where principals 
reported a high level of engagement of students, teachers, and parents in school processes were 
registeredfor parents' involvement in communication processes related to students' performance 
84%), respect for school regulations (63%), and teachers’ involvement in decision-making 
processes (61%). The lowest percentages (see Table 6.2) were observed for parents’ involvement 
in decision-making processes (1896), consideration given to students' opinions during decision- 
making processes (2896), and students' opportunities to participate in school decisions (3096). 
Eight countries recorded percentages above the international average for student participation 
in school decisions. They were Colombia, Croatia, the Dominican Republic, Estonia, Latvia, Malta, 
exico, and the Russian Federation. 


When we looked at the responses for the two positive answer categories combined (i.e., “to a 
arge extent" and "to a moderate extent"), we recorded an international average of 80 percent or 
above for almost all the question items. We observed slightly lower percentages for parents' and 
students' involvement in decision-making processes at school. We also noted that variation across 
countries tended to be greater for these two items than for the other items. 
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Table 6.1: Percentages of students at schools where principals reported students’ participation in school 


elections 

Country National percentages of students at schools where principals reported 

that all, nearly all, or most of the students: 
Elect their class representatives Vote in school council, school 
parliament elections 

Belgium (Flemish) 73 (4.1) v 55 (4.5) v 
Bulgaria 68 (3.8) v 50 (4.1) v 
Chile 98 (1.1) A 86 (3.1) A 
Chinese Taipei 22 (24) A A5 (42) v 
Colombia (r) 99 (1.0) A 99 (0.9) A 
Croatia 100 (0.0) A 98 SH A 
Denmark! 91 (2.1) A 92 (2.0) À 
Dominican Republic 95 (1.9) A 95 .6) A 
Estonia! (s) 76 (4.9) V 79 (44) 
Finland 98 (1.1) A 93 FA A 
taly 22 (3.5) v 1 (0.7) v 
Latvia! 88 (3.1) 75e (50) 
Lithuania 93 (2.1) A 79 (3.1) 

alta 85 (0.3) 80 (0.3) A 

exico 98 (1.2) A 8 2.7) A 

etherlands! (r) 46 (4.4) v 34 (52) v 

orway (9)! 99 (0.8) A 95 (2.0) A 
Peru 93155) ZN 85 (23) A 
Russian Federation 82 (3.2) 74 (3.6) 
Slovenia 99 (0.8) A iS 
Sweden: 92 (244) A 78 (3.6) 
ICCS 2016 average 85 (0.6) 74 (0.7) 
Countries not meeting sample participation requirements 
Hong Kong SAR 87 (3.6) 86 (3.6) 
Korea, Republic of? 100 (0.0) 100 (0.0) 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 100 (0.0) PS A683) 
(Germany)! (r) 


National percentage: 

À More than 10 percentage points above ICCS 2016 average 
A Significantly above ICCS 2016 average 

V Significantly below ICCS 2016 average 

WY More than 10 percentage points below ICCS 2016 average 


Notes: 

() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may 
appear inconsistent. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

+ Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 90% to 95% of National Target Population. 

? Country surveyed target grade in the first half of the school year. 

An “(r)” indicates that data are available for at least 70% but less than 85% of students. 

An "(s)" indicates that data are available for at least 50% but less than 70% of students. 
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School and classroom climate 


BECOMING CITIZENS IN A CHANGING WORLD 


School climate generally refers to "the shared beliefs, the relations between individuals and groups 
in the organization, the physical surroundings, and the characteristics of individuals and groups 
participating in the organization” (Van Houtte, 2005, p. 85 


asthe "impressions, beliefs, and expectations held by m 
school as a learning environment, their associated behavi 


em 


. Another framing refers to school climate 
bers ofthe school community about their 


or, and the symbols and institutions that 


zm 


representthe patterned expressions of the behavior" (Homana, Barber, & Torney-Purta, 2006, p. 3). 


School climate and the quality of the relationships 
teachers and among students) have the potential to 


WI 


thi 


n the school (between students and 


influence student achievement (Bear, Yang, 


Pell, & Gaskins, 2014) and may also reflect issues such as bullying at school (Powell, Powell, & 
Petrosko, 2015). More generally, recent research has shown associations between student- 


teacher relationships and a comprehensive range of 


(Quin, 2017). 


indicators of student engagement in school 


Some studies point out that students' perceptions of classroom climate may play a significant role in 
helping students understand the advantages of democratic values and practices (see, for example, 


£ 


O 


Hooghe & Quintelier, 2013). The CIVED survey included a set of six items that asked students 
how open they thought their classroom was open to discussion during their civic education lessons 
(Torney-Purta, Lehmann, Oswald, & Schulz, 2001). The derived index was a positive predictor 
civic knowledge and of students' expectations to vote as an adult (Schulz, 2005). The ICCS 


200? survey used a similar instrument, and the results of multivariate analyses confirmed the 
association between this construct and civic-related learning outcomes (Schulz et al., 2010). This 
association between a classroom climate receptive to discussion and positive civic outcomes has 
been one of the most stable findings across the IEA studies related to civic education since 1971. 
The many researchers who have conducted secondary analyses of the data have also confirmed 


the association. 


We included the same question, consisting of the items used for scaling in the previous cycle, in 
the ICCS 2016 student questionnaire. When responding to the question (which read, "When 
discussing political or social issues during regular lessons, how often do the following things 
happen?"), students were asked to consider any classes in which or teachers with whom they 


discussed political and social issues. The six ques 


tion items were in the form of statements: 


(a) "Teachers encourage students to make up their own minds" (ICCS 2016 average of students 


reporting this occurred sometimes or often: 7596); 

their opinions" (8596); (c) "Students bring up current 
(d) "Students express opinions in class even when t 
other students" (7496); (e) "Teachers encourage stud 
different opinions" (5996); and (f) "Teachers presen 


them in class" (72%). 


b) "Teachers encourage students to express 
political events for discussion in class" (4496); 
heir opinions are different from most of the 
ents to discuss the issues with people having 
t several sides of the issues when explaining 


We used the items to derive an IRT-based scale with an average reliability across countries 
(Cronbach's alpha = 0.77). The higher scores on the scale reflect stronger perceptions of a more 
open classroom climate (see Figure 6.1, Appendix D, for a description of this scale). We were also 
able to equate the 2016 IRT scale with the 2009 scale, so that the value of 50 reflected the average 
score of equally weighted countries in the previous cycle. This process allowed us to identify 
changes in scale scores for the countries that participated in both the 2009 and 2016 ICCS cycles. 


Table 6.3 presents a comparison of the average scale scores for the ICCS 2016 students’ 
perceptions and the ICCS 2009 students' perceptions of openness during classroom discussion. 
We recorded national scale scores above the international average in Chile, Chinese Taipei, Croatia, 
Denmark, Italy, Mexico, Norway, Peru, and Sweden. Of these countries, Denmark recorded the 
highest score. When we compared the results from the two ICCS cycles, we found no significant 
difference between the international average scores of the countries participating in both surveys. 
However, we did observe significantly higher scores between the two cycles (p < 0.05) in four 
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Table 6.3: National averages of students' perception of openness in classroom discussions 


Country 2016 2009 Differences 
(2016-2009) 40 45 50 55 60 
Belgium (Flemish) 50(03 V 49 (0.3) 0.6 (0.5) (ei 
Bulgaria 48 (0.3) V 48 (0.4) 0.2 (0.6) F3 
Chile 52 (0.3 A 52 (0.3) -0.1 (0.6) CH 
Chinese Taipei S(O) AN 50 (0.3) 1.7 (0.6) m 
Colombia 49 (0.3 V 50 (0.2) -0.9 (0.5) Um 
Croatia 51 (0:3 A - - imi 
Denmark! 54 (0.3 A 55 (0.3) -0.9 (0.6) E = 
Dominican Republic 48 (04 Vv 47 (0.3) 0.9 (0.6) | 
Estonia! 49 (0.3 V 50 (0.3) -1.0 (0.5) im | 
Finland 49 (0.2 V 49 (0.2) -0.3 (0.5) IN 
taly 53 (0.3 A 54 (0.3) -1.1 (0.5) Lm 
Latvia! 49 (0.2 V 510.3) -1.6 (0.5) EM 
Lithuania 49 (0.3 V 50 (0.3) -0.3 (0.5) m | 
alta 49 (0.2 V 46 (0.2) 3.6 (0.4) [| L| 
exico 51 (0.2 A 50 (0.2) 0.9 (0.5) E 
etherlandst 47 (0.3 V - - m 
orway (9): 52 (0.3 A 53 (0.5) -0.5 (0.6) m 
Peru DON A - - [| 
Russian Federation 8 (O. V 49 (0.3) -1.4 (0.6) EN | 
Slovenia 500.8) y 50 (0.3) 02 (95) ml 
Sweden 52 (0.4 A 51 (0.3) 1.5 (0.6) (Se 
ICCS 2016 average 50 (0.1 
Common countries average 50 (0.1 50 (0.3) O.1 (0.1) 
Countries not meeting sample participation requirements 
Hong Kong SAR 53 (0.5 = - e 
Korea, Republic of? 42 (0.4 - E ai 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 50 (0.5) - - = 
(Germany): 
ll] 2016 average score +/- Confidence interval 
Wl 200? average score +/- Confidence interval 
National average: Onaverage across items, students with a score in the range with this color 
A More than 3 score points above ICCS 2016 average have more than a 50% probability of indicating: 
A Significantly above ICCS 2016 average Never or rarely 
V Significantlybelow ICCS 2016 average Sometimes or often 


W Morethan 3 score points below ICCS 2016 average 


Notes: 

() Standard errors appear in parentheses. Statistically significant changes (p « 0.05) between 2009 and 2016 are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

" 

1 

2 


Met guidelines for sampling participation rates only after replacement schools were included. 
National Defined Population covers 90% to 9596 of National Target Population. 

Country surveyed target grade in the first half of the school year. 

No comparable data available. 


countries (Chinese Taipei, Malta, Mexico, Sweden), and significantly lower scores in Italy, Latvia, 
and the Russian Federation. 


Table 6.4 shows the associations between students' perceptions of openness in classroom 
discussions and (dichotomized) variables reflecting students' interest in civic issues (quite or 
very interested in political or social issues versus little interest), students' expected educational 
a 
k 


ttainment (students who expected to complete a university degree versus others), and civic 
nowledge (students at or above Level B versus others). The columns show the average scores in 
each comparison group (e.g., for males and females), while the bar chart in between graphically 
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illustrates the direction and size of the score point difference for each association: the red bars to 
the left of the zero line indicate score point differences where the students in the first (left-hand 
side) group had significantly (p « 0.05) higher values; the green bars indicate score point differences 
in which the other group had significantly higher averages. 


In all of the participating countries, students' perceptions of openness in classroom discussions 
had, on average, positive and statistically significant associations with students’ interest in political 
and social (civic) issues (a two-point difference), students’ expected level of educational attainment 
(university degree or no degree) (a two-point difference), and students’ civic knowledge (below or 
above Level B) (a four-point difference). 


To measure students' perceptions of student-teacher relationships at school, the ICCS 2016 
student questionnaire included the same set of five items that were used to measure this construct 
during ICCS 2009. The items were again in the form of statements (with students asked to give their 
level of agreement with each one): (a) "Most of my teachers treat me fairly" (ICCS 2016 average 
of students' agreement: 8796); (b) "Students get along well with most teachers" (7496); (c) “Most 
teachers are interested in students' wellbeing" (8396); (d) "Most of my teachers listen to what I 
have to say" (8196); and (e) “If | need extra help, | receive it from my teachers" (88%). 


These items formed an IRT-based scale with an average reliability across countries (Cronbach's 
alpha = 0.81). The higher values on the scale, which is described in Figure 6.2 in Appendix D, 
indicate more positive perceptions of student-teacher relationships. We equated the scale with 
the 2009 scale so that the value of 50 reflected the average score of equally weighted countries 
in the previous cycle. 


n general, students' perceptions of student-teacher relationships changed significantly between 
2009 and 2016 (see Table 6.5). The ICCS 2016 international average was significantly higher 
than the 2009 international average, and the national averages between the two cycles were 
significantly higher in 12 countries out of 21. The scale scores for 2016 showed eight countries— 
Bulgaria, Chile, Chinese Taipei, Colombia, Denmark, the Dominican Republic, Mexico, and Peru— 
scoring significantly above the international average. Two of these countries— Chinese Taipei and 
the Dominican Republic—recorded scale scores more than three points above the ICCS 2016 
international average. 


We also found significant associations between students’ perceptions of student-teacher relations 
at school and gender, expected education (students expecting to complete a university degree 
versus those not holding this expectation), and civic knowledge (students at or above Level B versus 
those below this level) (Table 6.6). On average across the participating countries, females' scale 
scores were slightly higher than the males' scores (a one-point difference), students expecting to 
complete a university degree scored higher than other students (a one-point difference), and those 
students at or above Level Bonthe civic knowledge scale had scores higher than the students with 
lower levels of civic knowledge (a difference of two points). 
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Table 6.5: National averages of students’ perception of student-teacher relations at school 


Country 2016 2009 Differences 
(2016-2009) 35 40 45 50 55 60 65 

Belgium (Flemish) 51 (0.2) V 49 (0.3) 2.5 (0.6) [| B 
Bulgaria 53 (03) A 51 (0.3) 2.0 (0.6) E 
Chile 54 (0.3) A 51 (0.3) 2.7 (0.6) miu 
Chinese Taipei 56 (OLS A 55/09) 5.2 (0.6) | NE 
Colombia 54 (03) A 54 (0.3) -0.4 (0.6) rm 
Croatia 5 re 7 - - im 
Denmark! 54 (0.3 A 52 (0.3) 2.6 (0.6) m 
Dominican Republic 60 (0.3) A 59 (0.3) 1.6 (0.6) i 
Estonia? 49 (0.3) Y A8 (0.3) 1.2 (0.6) m 
Finland 55 (Ole) 48 (0.2) 4.9 (0.6) | m. 
taly 53 (0.3) 51 (0.3) 1.3 (0.6) P 
Latvia! 46 (0.3 v 45 (0.3) 1.0 (0.6) 1 
Lithuania 50 (0.3) V 50 (0.3) 0.2 (0.6) m, 

alta 52 (0.2) 52 (0.3) 0.4 (0.6) m 

exico 55 (0.2 A 53 (0.2) 1.8 (0.5) E! 

etherlandst 50 (0.3 V - - [| 

orway (9) 52 (0.3 50 (0.4) 2.7 (0.7) DP 
Peru 55 (02 A - [| 
Russian Federation 50 (0.3) V 51 (0.3) 1.0 (0.6) EN 
Slovenia 48 (0.3 v 47 (0.3) 1.6 (0.6) r 
Sweden! 53 (0.4 51 (0.3) 1.5 (0.7) r 
ICCS 2016 average 52 (Ol 
Common countries average SA O 50 (0.3) ae KOL) 
Countries not meeting sample participation requirements 
Hong Kong SAR 51 (04 - - imi 
Korea, Republic of? 53 (0.2 - - [| 
Benchmarking participant not meeting sample participation requirements 
North Rhine-Westphalia 500:5) - - = 
(Germany): 

lll 2016 average score +/- Confidence interval 
Wl 200? average score +/- Confidence interval 

National average: On average across items, students with a score in the range with this color 
A Morethan 3 score points above ICCS 2016 average have more than a 50% probability of indicating: 
A Significantly above ICCS 2016 average Disagreement with positive statements 
V Significantly below ICCS 2016 average Agreement with positive statements 


W More than 3 score points below ICCS 2016 average 


Notes: 
() Standard errors appear in parentheses. Statistically significant changes (p < 0.05) between 2009 and 2016 are displayed in bold. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

T Met guidelines for sampling participation rates only after replacement schools were included. 

1 National Defined Population covers 90% to 95% of National Target Population. 

2 Country surveyed target grade in the first half of the school year. 

-  Nocomparable data available. 
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Different forms of bullying at school 


Bullying is defined as aggressive behaviors in 
verbally, or through use of the internet (Amer 


ican Educatio 
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1973; Wade & Beran, 2011). Scholars and other commenta 


symptom of dysfunctional social i 


countries, schools currently face the problem of bullyin 
context (American Educational Research Association, 20 
Gardella, & Teurbe-Tolon, 2016). Considera 


tended to hurt someone either physically, emotionally, 
nal Research Association, 2013; Olweus, 


tors generally consider bullying a 


nteraction at school (see, for example, Olweus, 1973). In many 


ble variation 


exist within a school (Atria, Strohmeier, & Spiel, 2007; Salmiva 


ThelCCS 2016 questionnaires included several questions on this topic as part of the more genera 


area of social relations at school. Despite the slight differences i 


in each question and the differences in the response categ 
bullying phenomenon from various perspectives and took i 
the perceptions of students, principa 


ullying) 
within their schools. 
The 
item 
inth 


ituations of verbal or physical abuse at school. T 
bout bullying. The first asked princi 


. Teachers were also asked to record 


ories, this set of questions explored the 
nto consideration likely dissimilarities in 
s, and teachers. Students were asked about their experience of 
S he school questionnaire contained two questions 
a pals for their perceptions of bullying at school and the second 
asked them about the activities their school had in place to counteract bullying (including cyber- 
b their perceptions of different forms of bullying 


g both in the school itself and in a cyber 
13; Corcoran & McGuckin, 2014; Fisher, 
in the incidence and type of bullying can 


li, 2012). 


nthe wording of the items included 


questionnaire for schools participating in the ICCS 200? Latin American option included 
s measuring students' experience of verbal or physical aggression at school. Many students 
e participating countries of this region reported physical aggression at school (Schulz, Ainley, 


Friedman, & Lietz, 2011). The ICCS 2016 international student questionnaire therefore included 
a question asking students about the level of verbal or physical bullying they had personally 


experienced at school. 


More specifically, this question asked students to respond to the situations depicted in each of 
the question's items by indicating how often they had experienced these situations within the 
past three months: (a) “A student called you by an offensive nickname;" (b) "A student said things 


about you to make others laugh;" 
attacked by another student;" (e) 
(f) "A student posted offensive pic 
sixitems to derive an IRT scale tha 


the higher scale scores indicated h 


item map in Figure 6.3, Appendix 


The students’ responses to this qu 


` 


D, 


C 


ying at school at least once in 


d 
ational averages ranging from 42 
t 


kname" (international average: 5596), with natio 
"A student said things about you that made oth 


the past three m 


to 67 percent. Th 


tures or text about you ont 


estion showed some variati 
the highest percentages of students being those who said th 


ers laugh" 


ational average scale scores for students' reports of for 
significantly higher than the ICCS 2016 average in Bu 
Republic, Lithuania, Malta, Mexico, Peru, and Slovenia. Natio 
of bullying were lower than the ICCS 2016 average in Denma 
the Russian Federation, and Sweden. Chinese Taipei recorded the lowest scale score (about four 


points below the ICCS 2016 average). 


y. 


C) "A student threatened to hurt you;" (d) “You were physically 
‘A student broke something belonging to you on purpose;” and 
he internet” We used the questions 
t had average reliability (Cronbach's alpha = 0.75), and on which 
igher frequencies of experie 


ncing verbal or physical abuse (see 


for a description of this scale). 


onacross countries (Table 6.7), with 
ey had experienced verbal forms of 
onths: "A student called you by an offensive 
nal averages ranging from 36 to 70 percent; 


(international average: 5696), with 


e lowest percentages were for cyber-bullying 
ernational average: 1096) and physical attack (1.696), with na 
|3 percent and from nine to 27 percent, respective 


tional averages ranging from six to 


ms of verbal and physical abuse were 
garia, Colombia, Croatia, the Dominican 
nal average scale scores for these forms 


rk, Finland, Italy, the Netherlands, 
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We identified statistically significant associations between students' experiences of physical or 
verbal abuse and each of the following three variables: gender, expected education (students 
expecting to complete a university degree versus those who did not), and civic knowledge (students 


ator above Level B versus those below this level) (see Table 6.8). Males scored higher than fema 


es 


onthe IRT scaleinallofthe participating countries, with the difference amounting to four scale score 


points above the ICCS average. Nearly every country also showed significantly higher scores 


£ 


Or 


students not expecting to complete a university degree (a one-point difference inthe ICCS average) 


and for 


(CCS 2016 as 
within the 
occurre 
student repor 
behaviors by o 
head» that 
teacher, th 
to «the princ 
was being «bu 
that s/he was 


According to 


ir school. | 
nce—“one to 


s/h 
esc 
pal, the 


five times a 
ted to « 
ther st 


hool he 


lied»;" 


the principals, the 


students. The principals also advi 


these inciden 
of students in 


schools where pri 


n Chinese Tai 
a 
incide 
perce 
mo 
nd 
he 


nts of s 


i 
( 


a 
a 
t 


their schoolsh 


specified in the que 
sroom level. Am 


clas 
for 


Table 6.10 shows the percentages of students in 
undertaken to prevent bullying. Nearly every coun 
carried out at the classroom level (intern 
directly addressed to students, such as training sessio 
use (international average: 7796). Meetin 
(international average: 7296). On average a 
those for expert-led school conferences 


Systems 


Teachers, too, were asked for the 
naire were similar to those includ 


question 


ntages above 


exico. In addi 


Another question i 


pei, Croatia, Den 


tudents engaged 


adim 


response categories (“one to five 


to percei 


ve the occurrence of ins 


e was <bullied> by a teach 


S 
ts to them. Table ó. 


i 
verage percentages were below 


n the ICCS 201 
plemented top 
stion's eight ite 
ong the activities were meetings w 
teachers, conferences led by experts, and train 


those with civic knowledge below Level B (a two-poin 


ed school principals to report on the frequency of speci 
[he question included six items and had 
nd "more than five ti 
the principal, the head-teacher, t 
udents;" (b) "A student reported to «the principal, t 
er;" (c) “A teacher reported to «the principal, the head- 
ad» that a student was <bullied> 
head-teacher, the school head» t 
(e) “A teacher repor 
being <bullied> by students;” and (f) “A parent reported 
teacher, the school head> that his/ 


month” a 


her son/daughter w 


most common forms 
9 summarizes the 


ncipals reported the di 


ark, Italy, Latvia, t 


in aggressive or dest 


the international average) was evident wit 
ng students in five countries: 
tion, the princi 
mselves were rarely being bullied. 


ó school questionn 
revent bullying ( 
ms included acti 


sch 
try 


cross countr 


for several o 


ir perceptions of bullyi 


times amonth’/“more 
tances of aggressive o 


tedto «the pri 


edthat teachers and parents were the people m 
principals' responses in 


he Russia 
the international average with respect 


Belgium (Flemish), Colombia, the 
pals' responses suggest th 


recorded 
ational average: 9496 
ns designed to foster responsible in 
gs with parents were also common across cou 


international average: 41%) and the development 
for reporting cyber-bullying (international average: 2596). However, we noted considerable 
variation in percentages across countries 


t difference in the ICCS average). 


fied aggressive behaviors 
onse categories denoting 
nth” The items were: (a) "A 
aggressive or destructive 
e head-teacher, the school 


two resp 
mes a mo 
he school head» 


by other students;” (d) “A teacher reported 
hat a student helped another student who 
ncipal, the head-teacher, the school head» 
to «the principal, the head- 
as being «bullied» by other students.’ 


of bullying at school were those amongst 
ost likelytoreport 
terms of percentages 


t aspects of bullying. 


+ 


fferen 


nd Slovenia, national 
to student-reported 
he opposite pattern 
h regard to parent-reported bullying 
Dominican Republic, Malta, 
at, in almost all countries, teachers 


n Federation, a 


ructive behaviors. T 


ut the initiatives 


n 


aire asked principals abo 


response categories: “yes’/“no’). The initiatives 
vities implem 
ith studen 
ing activities for responsible i 


the 
ies 


ented at both the school and 
ts and parents, training activi 
nternet use. 


ools where principals reported activi 
higher percentages for activi 
and for school-based activiti 
ternet 
ntries 
were 


of 


ies, the lowest percentages recorded 


f the activities. 


ng at school. The items used in the teacher 


ed in the school questionnaire and provided the same 


than five times a month"). Teachers seemed 
r destructive behaviors among students at 
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school as less frequent than 
in how often the teachers wi 
Chile, Dominican Republic, Fin 
discrepancy in other countries (Bu 
6.11). Few teachers reported being bullied by studen 


It is difficult to “quantify” the actual presence of bullyi 
in which different forms of b 


principals did. However, 
tnessed each of the beh 
and, Lithuania, Malta, 


BECOMING CITIZENS IN A CHANGING WORLD 


we observed relatively large discrepancies 
aviors in some countries (Belgium/Flemish, 
exico, Norway, Peru, and Sweden) and less 


garia, Chinese Taipei, Croatia, Italy, Latvia, and Slovenia) (Table 


ts. 


ng at school and the frequency of situations 


ullying occur. Among other reasons for this difficulty is the "culture 


of silence" that often persists among victims (Smith & Shu, 2000). Nevertheless, the ICCS 2016 
results confirmed the presence of different aspects of bullying at school, as well as the presence 


of activities undertaken by schools to prevent the 


than other types of aggression. 


m. Verbal bullying was more frequently present 


Implementation of civic and citizenship education at schools 


Several studies illustrate the importan 
students' construction and developmen 


t role that students' activities in the community play in 
t of knowledge and skills for active citizenship (Annette, 


2008; Henderson, Pancer, & Brown, 2013). Links between the school and its local community 
represent an opportunity for involving students in activities related to positive civic outcomes and 


that thereby contribute to the enhancem 


such activities (Schulz et al., 2010). Furth 
the questionnaires that principals and teachers answered (Schulz et al., 2010). 


ent of civic engagement. ICCS 2009 showed that in nearly 
every participating country most of the students had at least some opportunities to participate in 
ermore, in 2009, results were generally consistent across 


The ICCS 2016 school and teacher questionnaires included a modified version of the ICCS 2009 
questions that asked principals and teachers for their perceptions of the opportunities their target- 
grade students had to participate in activities carried out in the local community but organized by 
the school in cooperation with external groups or organizations. 


The nine items were (a) “activities related to environmental sustainability (e.g. <energy and water 
saving, recycling>);” (b) “human rights projects;” (c) “activities for underprivileged people or 
groups;” (d) “cultural activities (e.g. theater, music)" (e) “multicultural and intercultural activities 


Wi 


(g 


thin the «local community» (e.g. «promotion and celebration of cultural diversity, food/street 
market»);" (f) “campaigns to raise people's awareness (about social issues, of environmental issues) 
"activities aimed at protecting cultural heritage within the «local community»; (h) “visits to 


» 
D 


political institutions (e.g. «parliament house, prime minister's/president's official residence>);” 


and (i) “sports events.’ 


As in ICCS 2009, the two sets of items differed in format. Also, although the answer categories 
for principals in the 2016 questionnaire were the 2009 ones of “all or nearly all; “most of them; 


"some of them,’ and “non 


eor hardly any, we added the new option of "not offered at school" The 


response categories for teachers were a simple “yes” or "no^ 


Most of the students in 
their principals, they had 
activities in the commun 


the participating count 


ity (Table 6.12). On average, theh 


ries were attending schools where, according to 
opportunities to participate in at least some civic- and citizenship-related 
ighest percentages (expressed in terms 


of students attending schools where principals reported the various activities) were for sports 


events (88%), cultural ac 


The results from the teachers’ responses to the partici 


tivities (80%), and activities relate 
On average, the lowest percentages were for visits to poli 
aimed at protecting the cultural heritage (38%). 


dto environmental sustainability (61%). 
tical institutions (20%) and for activities 


pation question (see Table 6.13) were 


relatively consistent with the principals’ responses. On average, the highest percentages of teachers 
reporting they had carried out civic and citizenship activities in the local communities pertained 
to cultural activities (75%) and sports events (73%). The lowest percentages recorded were those 
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BECOMING CITIZENS IN A CHANGING WORLD 


for visits to political institutions (1696), human rights projects (3696), activities aimed at protecting 
cultural heritage (3996), and activities for underprivileged people or groups (3996). 


Activities related to environmental sustainability at school 


Education for sustainable development endeavors to develop learners' competence as community 
members and global citizens. This area of education “empowers learners to take informed decisions 
and responsible actions for environmental integrity, economic viability and a just society, for present 


and future generations, while respectin 


10 years, various scholars and educ 


ation 


g cultural diversity" (UNESCO, 2014, p.12). For at least 
alists have viewed education for sustainable development 


as an important aspect of citizenship education (Huckle, 2008). They also tend to see it as an 


interdisciplinary and holistic learni 


The ICCS 2016 school questionnaire included a question asking pri 
friendly practices their schools had implemented in order to furth 
development ("sustainable schools") and to enable students to h 
principles. The question contained five items reflecting these practices: (a) "differential waste 
collection;" (b) “waste reduction (e.g. «encouraging waste-free lunches, limiting the use of plastic 
disposable products>);” (c) “purchasing environment-friendly i 
printing, biodegradable cutlery and dishes>);” (d) “energy-saving 
encourage students' environment-friendly behaviors? Response ca 


ng ar 


tems (e.g. «recycled paper for 


ea, and to argue that it needs to involve the whole school 
community (Henderson & Tilbury, 2004). 


ncipals about any environment- 
er the principles of sustainable 
ave direct experience of these 


practices;" and (e) "posters to 


"to a moderate extent; "to a small extent,’ and "not at all” 


(to a "large extent/to a moderate ex 
The most common practices acros 
(international average: 8196) and 


common across participating coun 


The use of posters within the schoo 


S participating countries were 


tegories were "toa large extent; 


Table 6.14 sets out the percentages of students in schools where principals reported having adopted 
tent”) the environment-friendly practices listed in the question. 


those related to energy saving 


to differential waste collection (international average: 74%). 
| to support students’ environment-friendly practices was also 
tries (international average: 74%). Lower but still substantial 


percentages were recorded for waste reduction (international average: 6796) and for purchasing 


environment-friendly items (intern 


w 
differential waste collection were n 
in 
o 


bserved similar patterns (e, na 


alta, Slovenia, Sweden); purchase 


ith respect to the environment-fri 


ational average: 6096). 


end 


of environment-friendly items 


Slovenia, Sweden); energy-saving practices (Chinese Taipei, D 
Lithuania, Malta, Slovenia); and poster use (Bulgaria, Chinese Taipei, Colombia, Croatia, Dominican 
Republic, Latvia, Lithuania, Malta, Mexico, Slovenia). 


Another of the questions in the teacher questionnaire asked teach 


students participated at school in i 


as writing letters to newspapers or magazin 


networks, organizing activities promoting limiting water or energy 
in the community. All of these activities have the potential not 
only to enhance students' direct involvement and engagement in environment-friendly activities 


to environment-based enterprises 


T 


The principals' responses to the question also revealed considerable cross-national variation 
y practices schools had in place. National percentages for 
nore than 10 percentage points above the ICCS 2016 average 
Belgium (Flemish), Chinese Taipei, Croatia, Finland, Italy, Lithuania, Malta, and Slovenia. We 


tional percentages 10 scale score points or more above the 
international average) with respect to waste reduction (in Chinese Taipei, Finland, Lithuania, 


Chinese Taipei, Malta, Norway, 
enmark, Dominican Republic, 


ers whether their target-grade 


nitiatives and activities related to environmental issues, such 
es, signing a petition, posting comments on social 


consumption, and contributing 


thin the school and the local community but also to raise students' awareness of the impact of 


their behavior on the environment (Kyburz-Graber, 2013; Lundholm, Hopwood, & Kelsey, 2013). 
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National percentages of students in schools where principals reported that the school had adapted 
the following environment-friendly practices to a large or a moderate extent: 
Country Differential Waste Purchase of Energy-saving Posters to 
waste collection reduction environment- practices encourage 
friendly items students' 
environment- 
friendly behaviors 
Belgium (Flemish) 95 (19) A 71 (4.1 61 (4.1) 77 (3.6) 61 (44) Y 
Bulgaria 65 (8 7 wf 62 (3:7 58 (4.6) 80 (2.9) 87 (3:3) A 
Chile 30(42) Y 42 (46) Y 34 (4.1) Y 54 (44) Y 63 (4.4) Y 
Chinese Taipei 100 A 99 (0.8) A 99 (0.9) A 100 A 98 (12 A 
Colombia (r) 72 (4.1) 54 (51) Y 58 (4.4) J1(37) V 86 29) A 
Croatia 88 (2.3) TAM ere! Ser (GES) V eSI TTA 94 (1.9) A 
Denmark! 62 (3.9) Y 38 (3.5) Y 66 (3.4) 94 (20 A 57 (3.6) Y 
Dominican Republic UAA 75 (40 67 (4.4) 91 (26) A 91 (28) A 
Estonia! (s) 55 (4.4) 70 (48 40(55) Y 85 (3.9) 75 (4.7) 
Finland 963155) 96 (14 A 66 (3.7) 7909: OV (93) y 
taly 88 (26 A 57 (40) V 51 (4.6) V 64 (3.8) Y 66 (3.9) V 
Latvia! 66 (4.8) 55 (46) Ww 59 (4.3) 87 (3:7) 85 (4.0) A 
Lithuania 86 (2.6) A 82 (3.4) A 46 (44) Vv 98 (1.4) A 95 (21 A 
alta 84 (0.3) A 78 (0.4) A 75 (O4) A 92 (O3 A 91(04 A 
exico 59 (40) Y 72 (3.5 65 (3.8) 74 (3.3) V 89 (25) A 
etherlands! (r) SISS 4 26 (4.7) W gu nw. 61 (48) Y 27 (4.7) W 
orway (9): 78 (3.5) 63 (4.3 73(39) A 74 (4.0 40 (41 Y 
Peru 68 (3.2) 64 (3.5 Bil (oo) r S 76 (2.8) 74 (3.0) 
Russian Federation 51 (48) Y 44 (45) Y 35(37 Y 91 (2.7 A 80 (2.4) 
Slovenia 997 (05) 99 (05 A 88 (30 A 99 (05 A e 
Sweden! 78 (3.8) 81(36) A 77 (A1 A 66 (59) Y 39 (5.4) 
ICCS 2016 average 74 (0.8) 67 (0.8 60 (0.9) ei (O7 74 (0.7) 
Countries not meeting sample participation requirements 
Hong Kong SAR 84 (4.0) 85 (4.0 71 (5.1) 84 (4.3 76 (4.4) 
Korea, Republic of? 99 (0.9) 94 (9:2 95 (2.0) 29 (12 86 (4.0) 
Benchmarking participant not meeting sample participation requirements 
North-Rhine-Westphalia 67 (6.9) 61 (6.9 55 (69) 66 (6.6 36r (7:5) 
(Germany)! (r) 


National percentage: 

A More than 10 percentage points above ICCS 2016 average 
A Significantly above ICCS 2016 average 

V Significantly below ICCS 2016 average 


W Morethan 10 


Notes: 


percentage points below ICCS 2016 average 


() Standard errors appear in parentheses. Because results are rounded to the nearest whole number, some totals may appear inconsistent. 
(9) Country deviated from International Defined Population and 
t Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 9096 to 9596 of National Target Population. 

Country surveyed target grade in the first half of the school year. 
An “(r)” indicates that data are available for at least 70% but less 
An “(s)” indicates that data are available for at least 5096 but less 


Across partic 


surveyed adjacent upper grade. 


han 8596 of students. 
han 7096 of students. 


ipating countries, the most commonly reported activities were those related to 


water and energy consumption (with an international average of 4696 and 4896, respectively) 


(Table 6.15). 
a magazine/n 
averages sign 


ificantly above the ICCS average 


Lower percentages were recorded for signing a petition (896), writing letters to 
ewspaper (1296), and posting on social networks (1596). Countries with national 


for all the activities were Colombia, the Dominican 


Republic, Mexico, and Peru. Those with national averages significantly below the ICCS average 


were Belgium 


(Flemish), Malta, and Sweden. 
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Civic and citizenship activities in classrooms and teacher preparation 


Chapter 2 of this report described the general approaches that the ICCS 2016 schools were 
taking to deliver civic and citizenship education in their classrooms. The chapter also reported 
principals' and teachers' perceptions of the most important aims of this area of school education, 
and documented the types of pre-service and in-service training that teachers in the ICCS 
countries experience. In this section of the current chapter, we look at the activities carried out 
within participating schools' classrooms during civic and citizenship education lessons from two 
perspectives—students' and teachers. We also consider teachers responses to a question about 
their level of preparedness for teaching topics related to civic and citizenship education. 


The question in the ICCS 2016 student questionnaire on civic topics taught in school required 
students to indicate the extent to which they had learned about each of the following at their 
school: (a) “how citizens can vote in local or national election;" (b) "how laws are introduced and 
changed in «country of test»;" (c) "how to protect the environment (e.g. through energy-saving or 
recycling);" (d) “how to contribute to solving problems in the «local community>;” (e) "how citizen 
rights are protected in «country of test»;" and (f) "political issues and events in other countries" 


We used these items to derive an IRT-based scale called civic learning at school. It had an average 
reliability across countries (Cronbach's alpha = 0.80). The higher scale scores indicate higher levels 
of reported learning of civic issues at school. (For a description of this scale, see the item map in 
Figure 6.4, Appendix D.) 


On average across the participating countries, the highest percentages of students who said they 
had learned about the listed topics to a moderate or large extent were for how to protect the 
environment (8196), how citizens can vote in local and national elections (6496), and how citizen 
rights are protected in «country of test» (6196). The lowest percentages were for political issues 
and events in other countries (5296) and how to contribute to solving problems in the «local 
community» (55%). Significant differences emerged across the countries for all six topics (see Table 
6.16), suggesting that students in different countries experience different degrees of emphasis 
on the civic-related topics they study at school. 


Table 6.16 also shows the national average scale scores for students' learning of civic issues at 
school. Countries with the highest national average scale scores (three or more points above the 
(CCS 2016 average) were Chinese Taipei, Colombia, the Dominican Republic, Mexico, and Peru. 
Those with the lowest national averages were Belgium (Flemish), Estonia, Finland, Latvia, Lithuania, 


and the Netherlands. 


Our analyses of students' responses to the civic-topics question included looking for possible 
associations between the students’ learning of these topics and (dichotomous) variables reflecting 
students’ interest in civic issues (quite or very interested versus little interest), students’ expected 
educational attainment (a university degree versus no such degree), and civic knowledge (scores at 
or above Level B versus scores below this level). Table 6.17 presents the findings of these analyses. 


Positive and statistically significant associations were evident in all of the ICCS 2016 countries 
between students' reports of civic learning at school and students' interest in social and political 
issues. The average difference between the national scores for students who were quite or very 
interested in the itemized civic issues was three scale score points above the ICCS average. We 
also registered in most participating countries higher scale scores for students who anticipated 
completing a university degree. Here, the difference was two points on average across the 
participating countries. Students at or above Level B of civic knowledge scored higher than students 
below this level, with an ICCS average difference of three points. 
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CHAPTER 7: 


Explaining variation in students' civic 
knowledge and expected civic engagement 


Chapter highlights 


ICCS 2016 provides insights into factors associated with civic knowledge. 


e Analyses of multilevel factor models showed large differences (overall, within, and between 
schools) across countries with respect to variation in students’ civic knowledge. (Table 7.1) 


e The analyses also showed considerable variation across countries with respect to how 
much specified factors explain this variance. 


e Students characteristics and social background were important predictors of their civic 
knowledge. (Table 7.2) 


e Factors reflecting processes of civic learning showed relatively consistent associations 
across countries with civic knowledge at the level of individual students, but less consistency 
at the school level. (Tables 7.3, 7.4) 


* [he model controlling for student characteristics and social background showed some of 
the apparent associations between civic learning factors and civic knowledge as no longer 
significant. Students' perceptions of open classroom climate for discussion as well as their 
civic engagement at school remained significant predictors, however. (Table 7.5) 


ICCS 2016 data analyses identified factors associated with students' expected engagement 

in civic activities. 

e Multiple regression models using student background, experience with civic engagement, 
disposition toward engagement, and beliefs about citizenship and institutions explained 
between a quarter and a third of the variation in expected civic participation. (Tables 7.6, 
7.9) 


* Parental interest and students' interest in civic issues were the strongest student- 
background predictors of expected civic engagement. Female students were less inclined 
than male students to expect they would become actively involved politically in the future. 
Tables 7.7, 7.10) 


e Experience with civic engagement in the community or at school tended to be positively 
associated with students' expected civic engagement as adults. (Tables 7.7, 7.10) 


e Students’ civic knowledge and self-efficacy as well as students’ beliefs were consistent 
predictors of expected electoral and active political participation. (Tables 7.8, 7.11) 


* While more students with higher levels of civic knowledge were more likely to expect 
electoral participation, they were less likely to expect more active political involvement. 
(Tables 7.8, 7.11) 


e Students who believed in the importance of civic engagement through established channels 
were also more likely to expect future civic participation. (Tables 7.8, 7.11) 


e Inmostcountries, trust incivic institutions was positively associated with expected electoral 
and active political participation. (Tables 7.8, 7.11) 
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Conceptual background 

This chapter presents some results of the multivariate analyses of ICCS 2016 data that we 
conducted in an effort to explain variation in three commonly investigated outcomes of civic 
and citizenship education: civic knowledge, expected electoral participation, and expected active 
political participation. The content of this chapter is primarily concerned with the following 
research questions: 


e RQ 2a: Are there variations in civic knowledge that are associated with student characteristics and 
background variables? 


e RQ 2b: Which contextual factors explain variation in students’ civic knowledge? 


e RQ 3: What is the extent of students’ engagement in different spheres of society, and which factors, 
within or across countries, are related to it? 


The chapter includes not only multilevel analyses of the student-level and school-level factors that 


potentially exp 


participation") 
Analyses of be 


ain variation in stud 


modeling of students' expectatio 
and in more active politica 


tween-school varia 


ns of participating in electoral 


tion in civic knowledge revealed 


ents’ civic knowledge but also (si 


ngle-level) multiple regression 
activities ('expected electoral 


activities ('expected active political participation"). 


considerable variation across 


schools in most countries that consequently made multilevel modeling of student-level and school- 
evel factors viable. In contrast, between-school variation for indicators of expected participation 
was considerably more limited, thus making multilevel modeling much less appropriate. We 
therefore decided to use a single-level multiple regression modeling strategy for these indicators 
instead. 


The analyses presented in this chapter focus on data drawn from the ICCS 2016 student test and 
questionnaire. Because the non-response rates in ICCS 2016 were higher for the teacher and 
school principal questionnaires than for the student instruments, we adopted this focus so that 
we could maximize the number of countries included in this first set of multivariate analyses of 
the ICCS 2016 data. We expect that other researchers conducting further multivariate analyses 
ofthe released ICCS 2016 data will draw out additional indicators from these and other sources, 
and that they will use the results presented in this chapter as a reference point for those more 
detailed analyses. 


Although our statistical modeling used predictor variables to "explain" variation in dependent 
variables, our results should not be interpreted as indicating causality. Given the limitations of 
international large-scale assessments and their cross-sectional designs (Rutkowski & Delandshere, 
2016), it is not possible to reach firm conclusions about causal relationships from the findings 
presented in this chapter. We therefore encourage readers to regard these results as a review of 
associations between the dependent variables (civic knowledge, expected electoral participation, 
and expected active political participation) and relevant contextual variables. Our findings may 
suggest the possibility of causal relationships, but observed significant effects are not necessarily 
evidence of causality. Within our statistical model, there is a clear distinction between exogenous 
and endogenous variables; but these, too, do not easily translate into firm conclusions about 
causality. 
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Explaining variation in civic knowledge: the history of IEA studies and 
the background provided by theoretical approaches 


Numerous studies have identified associations between a wide range of factors and students’ civic 
knowledge. The first IEA Civic Education Study in 1971 identified (male) gender, socioeconomic 
background, and encouragement of independent expression of opinion at school as factors 
positively associated with students' civic knowledge (Torney, Oppenheim, & Farnen, 1975). Chall 
and Henry (1991) pointed out an association between civic knowledge and level of reading literacy. 
Their finding received support from analyses of data from the American National Assessment of 
Educational Progress (NAEP) showing a positive association between students' use of English at 
home and their level of civic knowledge (Niemi & Junn, 1998). 


Indicators of socioeconomic background such as parental education and family income have also 
beenreported as positive correlates of civic knowledge (Lutkus & Weiss, 2007; Niemi & Junn, 1998). 
Data from CIVED 1999 revealed home literacy and parental education as positive predictors of 
ivic knowledge across countries (Amadeo, Torney-Purta, Lehmann, Husfeldt, & Nikolova, 2002; 
Torney-Purta, Lehmann, Oswald, & Schulz, 2001). Evidence also exists of context-related influences 
of socioeconomic background, such as home literacy and the socioeconomic complexion of the 
school, on civic knowledge (Schulz, 2002; Schulz, Ainley, Fraillon, Kerr, & Losito, 2010).* 


CH 


Using NAEP data from 1988, Niemi and Junn (1998) assumed if students are to acquire civic 
knowledge, they need to be exposed to relevant information and to have the motivation to learn. 
Asindicators of exposure,the authorsused home-environment and school-relatedfactors,such as 
curriculum, coursework, and recent civic instruction at school. They also identified students’ plans 
toattend college, their participation in mock elections, and their enjoyment of studying civic-related 
topics as potentially important factors. After controlling for other variables in a multiple regression 
model, the authors found significant positive associations between two student variables—taking 
classes or courses featuring civic topics and participating in role-played elections or mock trials— 
with students’ civic knowledge. Both CIVED 1999 and ICCS 2009 confirmed positive associations 
between home-related factors of civic learning (e.g., discussions about civic issues, access to media 
information) as well as school factors (e.g., openness of the classroom climate, student participation 
at school) and civic knowledge (Schulz et al., 2010; Torney-Purta et al., 2001). 


The CCS 2016 assessment framework (Schulz, Ainley, Fraillon, Losito, & Agrusti, 2016) assumes 
that acquisition of civic knowledge is influenced by contextual factors that function at different 
levels (e.g., community, school/classroom, home environment) and can be characterized as either 
antecedents or processes. Antecedents (factors such astest language use at home or socioeconomic 
background) set some constraints on student learning about civic-related issues and how it takes 
place. Factors directly related to the learning process (classroom climate for civic learning, student 
activities) are further important elements of context that potentially influence the development 
of civic-related knowledge and understanding as well as of civic attitudes and engagement. 

u 

^ 


accordance with Bronfenbrenner's ecological systems theory (1979), which proposes that m 
systems interact with one another and influence young people's cognitive development 
contacts adolescents have with family, school, peers, and the wider community all contribute t 
the development of their civic knowledge and act as agents of socialization, while young peop 
themselves play an important role in shaping the ways in which these environments affect their 
development. 


Bourdieu's theory of economic, cultural, and social capital (Bourdieu, 1986) provides a further 
perspective on the influence that multiple interacting factors have on the development of 
students' civic knowledge. Economic capital, as a resource for human capital (skills, knowledge, and 


1 Further articles presenting analyses of factors explaining civic knowledge can be found in an annotated bibliography of 
secondary analyses of the IEA civic education studies compiled by Knowles and Di Stefano (2015). 
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(habits and dispositions), and social capital (societal links to other 
e) provide important elements shaping the development of adolescents. This perspective not 


only emphasizes the importance of socioeconomic background but also recognizes the relevance 


of 


in 


other forms of resources, 
Coleman (1988) conceptua 
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including 


actions as well as his or her learning efforts. 


Drawing on these perspectives, we selec 
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- Students' expected level of education (1 = expects a university degree, O = other 


students) 


Students' interest in political and social issues (1 = quite or very interested in political 
and social issues, O = other students) 

Students' socioeconomic background (nationally standardized with averages of O and 
standard deviations of 1) 


- Schools' average socioeconomic background (aggregated nationally standardized 


scores). 


e Civic learning outside school (Models 2 and 3): 


i Students' discussion of political and social issues (IRT scale, nationally standardized 
scores with averages of O and standard deviations of 1; items and scale are described 
in more detail in Chapter 4) 


- Students' use of media information (1 = use at least weekly either TV news, newspaper, 
or the internet to inform themselves about political and social issues, O = other 


students). 


e Civic learning at school (Models 2 and 3): 


- Students' learning about civic issues at school (IRT scale, nationally standardized 
scores with averages of O and standard deviations of 1; see Chapter 6 for details) 


- Students' perceptions of an open classroom climate for discussion (IRT scale, 
nationally standardized scores with averages of O and standard deviations of 1; see 


Chapter 6 for details) 


- Students' participation i 
scores with averages of O and standard deviations of 1; some items included in this 
scale are described in more detail in Chapter 4). 


n civic activities at school (IRT scale, nationally standardized 


e School learning context (Models 2 and 3): 


- Schools' avera 


standardized scores 


ge studen 


t learning about civic issues at school (aggregated nationally 


- Schools' average student perceptions of an open classroom climate for discussion 


(aggregated nationa 


ly standardized scores) 


- Schools' average student participation in civic activities at school (aggregate 


nationally stan 


dardized scores). 


Students' socioeconomic background was a composite index derived from highest parental 
occupation, highest parental educational attainment, and home literacy (measured as the number 


of books at home). This 


index, constructed in a similar way to the corresponding ICCS 2009 index 


(see Schulz & Friedman, 2011), was standardized nationally so that within each participating 
country the scale had an average of O and a standard deviation of 1. 


All other questionnaire 


although there are lim 


itations in 


aggregated at the school level are 


expected changes, with 


a nationa 


-based scales were also standardized so that, within each country, scale 
scores had an average of O and a standard deviation of 1. The unstandardized regression coefficients 
therefore represent a change in t 
Chapter 3for details), with an incre 
variables. Because we took this approach, the coefficients should be interpreted as effect sizes, 


he dependent variables (here: civic knowledge test scores, see 
ase of one national standard deviation in each of the independent 


terms of their comparability across countries. Scale scores 
inthe same metric as the original scales, and coefficients reflect 
(student-level) standard deviation of 1. Categorical variables 


were coded with values of 1 and O so that the regression coefficients would reflect the net effect 
of the difference between categories. 
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Given the hierarchical nature of the data as well as our observation of substantial proportions 
of variance between schools, we carried out multivariate mu 
explanation of this type of analysis, see, for example, Raudenbush & Bryk, 2002). We estimated, 
for each national sample, two-level hierarchical models in w 


schools. We used MPlus (Version 7, see Muthén & 
obtained estimates afte 


he st 


Itilevel regression analyses (for an 


hich students were nested within 


uthén, 2012) to conduct analyses and 
r applying sampling weights at t 


udent and school levels.? Because 


the ICCS 2016 sampling design typically meant only one classroom was sampled from within each 


school, itis not possible 


to separate between-schoo 


variation from between-classroom variation 


(Rutkowski, Gonzalez, Joncas, & von Davier, 2010). In our modeling, we treated (as noted above) 


the students as nested within schoo 
sampled and assessed. 
be provided in the ICCS 2016 technical report 


Schulz, Carste 


During multivariate analyses, proportions of missing data m 
variables are included in the model. For the multilevel analyses of civic knowledge, 93 percent of 


students, on average, had valid data for all variab 


Republic had a considerably lower proportion of valid data, wi 


sample. Therefore, data from this country are 
interpreted with some cauti 
Korea, both of which did not meet 


Table 7.1 shows estimates o 
civic knowledge across the 
differed considerably across the countries, ranging from six percent in Finland and Norway to 
etherlands; on average, we found 23 per 
level. On average cross-nationally, Model 1 (containing student background and social context 


55 percent in the 


variables as predic 


tors 


exp 


between-school variance. 


ofthe within-school var 


included all variables), 
percent, respectively. 


Analyses revealed consi 


For Model 1, esti 


within schools, and 


The graphic on the 


student level (left sid 
how much each mod 


acrossthe ICCS 20 
This observation is 


Schulz et al., 2010). 


mates of explained va 


el explained the varian 
16 countries in bo 


flagged in the an 
on, as should the results from Ho 
EA sample participation ra 


s, even in schools where more than one classroom had been 
Details regarding the multilevel modeling presented in this chapter will 


ns, Losito, & Fraillon, forthcoming). 


ay increase considerably as more 


esincluded inthe model. However, the Dominican 


th only 81 percent of the weighted 
alysis tables, and results should be 
ng Kong (SAR) and the Republic of 
te requirements. 


f overall variance? and between-sc 


hool and within-school variation in 


(CCS 2016 countries. The percen 


odel 2 (containing civic learning fa 


iance and 32 percent of the between-sc 
the corresponding estimates at student and school level were 20 and 71 


n schools, ranging 


variance explanation ranged from zero t 


between schools. 


right-hand side of Table 7.2 illustrates the proportions of variance found at 
eofthe graph) and school level (right side of graph). The color shadings indicate 
ce. The bar chart illustrates the considerable differences 
th overall between-school variation and explained variance. 
in line with previous comparative multilevel analyses of civic knowledge (see 


ates of explained variance ranged from nine to 30 percent 
from 45 to 90 percent 


tages of between-school variance 


cent of the variance at the school 


ained 16 percent of the within-school variance and 63 percent of the 


ctors) explained only eight percent 
hool variance. With Model 3 (which 


derable variation in the proportions of explained variance across countries. 
riance ranged from a minimum of six to a maximum of 28 
percent within schools, and from 36 to 86 percent between schools. For Model 2, the lowest 
variance explanation was four percent with 
the between-schoo 
included all predictor variables, estim 


to a maximum of 15 percent, while 
o 68 percent. For Model 3, which 


2 Student-level and school-level weights were normalized so that at each level the sum of weights was equal to the 
number of sampled students or schools. 
3 The overall variance was computed as the sum of within-school and between-school variance. Note, however, that with 
multilevel modeling, this variance is not necessarily equal to the square of the standard deviation of test scores in a 


country. 
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7.1). The average net effec 
After we controlled for civi 
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variance across t 


Table 7.3 shows 


od 


hree of w 


the 


fference in Mod 


all or not very 


included in 


ve effects | 


es out 


home 
in 
di 


dno 


itical or social issues was positi 
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el 1 regression coefficients recorded (o 
international standard deviation) were for Be 
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tandardized regression coefficients for stu 
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standard deviation was associated with a very small test score difference of about three points. 
We found similar associations after controlling for student characteristics and socioeconomic 
context (Model 3). 


In line with findings from ICCS 2009, all of the ICCS 2016 countries, except Lithuania and the 
etherlands, recorded significant positive associations between students' perceptions of an open 
assroom climate for discussion of political and social issues and civic knowledge. On average, 
change of 12 test score points (about an eighth of an international standard deviation) was 
ssociated with a change in one (national) standard deviation in the open classroom climate scale. 
Theregression coefficients were only slightly smaller after we controlled for student characteristics 
and socioeconomic factors (Model 3). 


C 
a 
a 


Co 


tudents' engagement in civic 


vic knowledge in 


activities at school was significantly and positively associated with 
16 countries. On average, a change in one national standard deviation was 
associated with a change of almost nine civic knowledge scale points. When we included student 
characteristics and socioeconomic background in our modeling (Model 3), we found a significant 
positive association for this variable in 13 countries, with an average net effect of five scale points. 


Table 7.4 shows the multilevel regression coefficients for the three variables related to civic learning, 
which were aggregated at the school level. Based on analyses of Model 2, average perceptions 
of students' learning of civic issues were significant positive predictors of civic knowledge in four 
countries (Chile, Chinese Taipei, Mexico, Peru); the effects were negative in two countries— Bulgaria 
and the Netherlands. According to the Model 3 analyses, the only country where we recorded a 
statistically significant positive regression coefficient was Chile. 


O. 


=) 


Average school-level perceptions of open c 
knowledge in eight countries in Model 2. 


assroom climate were positively associated with civic 
This predictor remained significant in five countries 
after we controlled for student characteristics and socioeconomic context (Model 3). Average 
measures of students’ civic engagement at school were significantly positively associated with 
civic knowledge in two countries (Belgium/Flemish, Netherlands), while in two other countries 
(Dominican Republic, Peru) we recorded significant negative relationships. According to Model 
3, this variable had statistically significant associations in only two countries—Bulgaria, where it 
was a positive predictor, and Peru, where it was a negative predictor. 
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Table 7.4: School-level regression coefficients for civic knowledge (school context for civic learning) 

Country Student learning of civic issues Open classroom climate Students' civic engagement 

(aggregate) for discussion (aggregate) at school (aggregate) 
Model 2 Model 3 Model 2 Model 3 Model 2 Model 3 

Belgium (Flemish) 15 (124) 5.7 (6.7) 0.5 (10.9) -6.8 (9.3) 318 (8.9) 43 (6.9) 
Bulgaria -54.9 (19.7) =3)9' (19:9) 79.6 (14.9) 27.3. (10:1) 20.3. (17.2) 210 (9.2) 
Chile 32.6 (15.4) 33.2 (8.7) 25.1 (15.2) 87 (78) -1.5 (14.1) -5.1 (9.9) 
Chinese Taipei 35:6) (125) 42 (7.8) 74 (13.1) -22 (8.1) 9.0 (18.2) 148 (114) 
Colombia -274 (17.0) -257 (13.8) 61.5 (12.7) 34.7 (142) -6.4 (11.9) -2.3 (10.8) 
Croatia =3.9 (12,5) 65 (10:9) 20.0 (10.4) 8.0 (9.1) DA (7.4) 25 (65) 
Denmark! 6.2 (13.6) 90 (107) 26.4 (12.3) 23 (7.2) -16.6 (9.7) -124 (8.0) 
Dominican Republic (r) 15 (43) -9.1 (10.1) 329 (122) 18.1 (94) -24.7 (11.5) -12.5 (8.8) 
Estonia! -2.7 (9.0) 82 (7.6) 38.4 (11.1) 21.0 (8.8) 0.2 (8.8) 1.5 (6.7) 
Finland -1.6 (8.5) -4.9 (7.0) -2.2 (9.5) -2.7 (9.0) 50 (8:3) -2.3 (8.7) 
taly 0.5 (12.1) -3.1 (8.3) -104 (14.9) -15.2 (9.5) 9.6 (6.4) 43 (4.7) 
Latvia! 74 (16.1) 29.3 (14:0) 10.6 (14.3) Om) -22.5 (13.4) -16.9 (11.6) 
Lithuania -19.9 (22.1) -7.9 (12.0) 6.8 (17.8) 8.3 (13.6) -5.0 (20.1) 6.7 (10.9) 

alta -30.2 (17.6) -9.3 (14.4) 72.0 (18.4) 32.6 (19.0) TIRS) Bale OD) 

exico 42.6 (15.3) 3.5 (84) 13.3 (14.9) 0.6 (7.4) -1.0 (18.6) 8.6 (9.8) 
etherlandst -38.2 (15.8) -13.0 (9.5) 82.4 (17.0) 36:3 (122) 34.7 (15.6) 7.5 (100) 
orway (9): 80 (13.0) 9.3 (10.4) 6.8 (11.1) O3 (11.0) 19 (10.7) 2.9 (9.0) 
Peru 32.2 (121) 6.8 (10.1) 56.8 (12.0) 38.1 (9.0) -34.2 (14.2) -21.9 (9.5) 
Russian Federation 13.5 (14.6) 7.2 (104) 5.4 (10.1) 91 (10.2) -14.5 (13.0) -11.3 (10.4) 
Slovenia DA (7.2) Z97055) 0.5 (7.4) O7 (66) 0.4 (8.1) STEZ) 
Sweden! 24 (13.4) 11 (10.2) 5.5 (12.6) -9.9 (9.5) 5.0 (8.5) 6.6 (9.1) 
ICCS 2016 average (ONE EI) SU! (98) 25.7 (219) 10.4 (2.3) 0.8 (2.8) 0.0 (2.0) 
Countries not meeting sample participation requirements 
Hong Kong SAR 79.5 (24.8) 63.0 (21.2) -4.1 (17.5) 0.6 (16.5) 72.1 (20.1) 54.5 (24.1) 
Korea, Republic of? 6.3) (12/0) 12 (109) -44 (11.9) 16.6 (8.2) 38.4 (10.8) -22 (10.8) 
Notes: 
() Standard errors appear in parentheses. Statistically significant coefficients (p « 0.05) are displayed in bold. 

9) Country deviated from International Defined Population and surveyed adjacent upper grade. 

es only after replacement schools were included. 
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+ Met guidelines for sampling participation ra 
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Country surveyed target grade in the first half of the school year. 


An “(r)” indicates that data are available for at least 70% but less than 8596 of students. 


Explaining variation in expected civic participation in the future 
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Table 7.5: Summary of statistically significant effects across countries 
Predictor variables MODEL 1: MODEL 2: MODEL 3: 
Number of countries where Number of countries where Number of countries where 
the predictor had a the predictor had a the predictor had a 
statistically significant... statistically significant... statistically significant... 
positive effect | negative effect | positive effect | negative effect | positive effect | negative effect 

Students' personal and social background 
Gender (female) 18 0 16 0 
Test language used at home 15 0 15 0 
Expected university education 21 0 21 0 
Interestin political or social issues 13 0 10 1. 
Socioeconomic context 
Socioeconomic home background 2 0 21 0 
Average socioeconomic background 16 0 18 0 
(aggregate) 
Civic learning outside school 
Discussion of political or social issues 10 3 3 4 
Media information 4 0 4 0 
Civic learning at school 
Having learned about civic issues 7 2 7 il 
Open classroom climate for discussion 19 W 19 0 
Civic engagement at school 16 0 13 W 
School and community learning context 
Student learning of civic issues (aggregate) 4 2 1 Ü 
Open classroom climate for discussion 8 0 0 
(aggregate) 
Civic engagement at school (aggregate) 2 2 1 1 
The analyses presented in this chapter focus on explaining variation in two variables related to 


students' expectations to participate as adults: expected electoral participation and expected active 


political participation (see Chapter 4 
example, Quintelier, 2008), we found 


for details). In line with findings from other studies (see, for 
only relatively low proportions of between-school variation 


inthe dependent variables. We therefore chose a single-level multiple regression approach when 


analyzing the factors explaining variat 


on in this variable. 


Toexplain variation in the dependent variables, we identified four groups of independent variables: 


(a) variables related to students' bac 


related to past or current participati 


variables related to students' dispos 


ground such as gender or students' interest; (b) variables 
on in community groups or organizations or at school; (c) 


itions for engagement, such as citizenship self-efficacy and 


civic knowledge; and (d) variables related to students' beliefs about citizenship and institutions. 


The individual variables that we selected as predictors were as follows: 


e Student background variables: 


- Students' gender (female = 1, male = 0) 


- Students' socioeconomic background (nationally standardized with averages of O and 


standard deviations of 1) 


- Parental interest in political and social issues (1 = having at least one parent quite or very 
interested in political and social issues, O = other students) 


- Students’ interest in political an 


d social issues (1 = being quite or very interested in political 


and social issues, O = other students). 


e Students’ experience with civic participation: 


- Participation in community organizations and groups (IRT scale, nationally standardized 
scores with averages of O and standard deviations of 1; some of the items included in this 


scale are described in more det 


ail in Chapter 4) 
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- Participation in civic activities at school (IRT scale, nationally standardized scores with 
averages of O and standard deviations of 1; some of the items included in this scale are 
described in more detail in Chapter 4). 


e Students dispositions for civic engagement: 


- Students' sense of citizenship self-efficacy (IRT scale, nationally standardized scores with 


averages of O and standard deviations of 1; see Chap 
- Civi 
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5 The differences between each of the comparison models with the full model provide an estimate of the unique variance 
attributable to each block of variables. The difference between the sum of block variances and the explained variance 
by all predictors provides an estimate of the common variance attributable to more than one block of variables. 
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coefficients are relative to the metric of the two (equated) questionnaire scales, where 10 reflects 
one international standard deviation for equally weighted countries in ICCS 2009.5 


Table 7.6 shows the percentages of variance in students’ expected electoral participation explained 
by student background factors alone and by the combined model. Student background factors 
explained, on average, 12 percent of the variance (ranging from 4% to 22%), while the combined 
model explained 31 percent of the variation in the criterion variables on average across the ICCS 


Table 7.6: Explained variance for expected electoral participation 
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Country Percentage of variance explained Proportion of unique variance explained by each set 
by student characteristics by full model I OF dus Se by morethanone 
and background only 0 10 20 30 40 50 
Belgium (Flemish) 1^ (1:5) 28 (1.5) — I 
Bulgaria C^ HL AT sey si 
Chile 0 (0.9) 35 (14) WH 
Chinese Taipei 7 (09) 28 (1.5) -—— — 
Colombia 7 (09) 25 (14) mamamanmi 1 
Croatia 1 1.4 fe Ub 
Denmark! 22 12 41 (1.5) EE —315 « | ] 
Dominican Republic (s) AL 07 Geck db) mam ` 
Estonia! 12 (12) 33 (18 
Finland 8 (14) o ©) g m  . | 
taly 1 12 28 (17) EE 
Latvia! Tis A ot 120 LL 
Lithuania 9 (11) 29 (17 -— — 
alta a wa SES m 
exico 6 (09) 30 (14 amam 
etherlands! 9 TZ ZR RO) o | 
orway (9): 5 1.0 34 (13) EH  — | 
Peru 7 (09) DONE (es RE 
Russian Federation 8 1.0 33 (17) 
Slovenia il dE er Tb B | 
Sweden! 21 (1.6) 36 (24 ms 7 
ICCS 2016 average 12 ë) sil (4 m 
Countries not meeting sampling requirements 
Hong Kong SAR 2 (11) 29 (18 
Korea, Republic of? 9 (13) DONDE wa 
Notes: . . . 
() Standard errors appear in parentheses. W Variance uniquely explained by student background 
(9) Country deviated from International Defined Population and Bl variance uniquely explained by past or current civic 


surveyed adjacent upper grade. 


T Met guidelines for sampling participation rates only af 


replacement schools were included. 


1 National Defined Population covers 90% to 9596 of National Target 


Population. 


N 


fter 


Country surveyed target grade in the first half of the school year. 


An “(s)” indicates that data are available for at least 50% but less than 


70% of students. 


An "(s)" indicates that data are available for at least 5096 but less than 


7096 of students. 


participation 

EI Variance uniquely explained by students’ dispositions for 
engagement 

D] Variance explained by students’ beliefs 

Variance explained by more than one set of variables 


6 In the multilevel modeling for civic knowledge presented earlier in this chapter, regression coefficients reflected the 
metric of civic knowledge test scores, where 100 was the international standard deviation for equally weighted countries 
in ICCS 2009. Therefore, and also due to the differences across modeling approaches (i.e., multilevel versus single-level 
regression), the size of regression coefficients should not be compared across the different analyses presented in this 


chapter. 
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Table 7.7: Multiple regression coefficients for expected electoral participation (student background and civic participation) 


Country Student background variables Current and past participation 
Gender (female) Socioeconomic Parental Students' Participation in Participation in 
background interest interest community Civic activities 
organization at schoo 
and groups 
Belgium (Flemish) -0.8 (0.3) 0.1 (0.2) 1.2 (0.4) 2.3 (04) 0.2 (0.2) 0.4 (0.1) 
Bulgaria 0.2 (04) 01 (0.2) 2.8 (0.5) 1.6 (0.4) 0.2 (0.3) 0.2 (0.2) 
Chile 0.4 (0.3) 0.2 (0.1) 2.0 (0.3) 1.0 (0.3) 0.1 (0.2) 0.9 (0.2) 
Chinese Taipei -0.2 (0.2) 0.2 (0.1) 0.7 (0.3) 1.3 (0.2) 0.2 (0.1) 0.3 (0.1) 
Colombia 0.1 (0.3) -0.1 (0.1) 13 (0.3) 14 (0.3) 0.2 (0.2) 0.2 (0.2) 
Croatia -0.5 (0.3) 0.4 (0.2) 2.2 (0.5) 1.3 (0.3) 01 (0.2) 0.2 (0.2) 
Denmark? 0.7 (0.2) 0.3 (0.1) 2.0 (0.3) 2.0 (0.2) 0.3 (0.1) 0.5 (0.1) 
Dominican Republic (s) 02 (03) OO T 1.3 10/3) 0.2 (0.4 oo m 07 02) 
Estonia! -0.2 (04) 0.3 (0.2) 1.7 (0.3) 1.4 (0.4) 0.2 (0.2) 0.2 (0.2) 
Finland OO (0.3) 0.6 (0.1) 24 (0.3) 1.4 (0.3) 0.1 (0.1) 0.5 (0.1) 
taly -02 (0.2) 0.1 (0.1) 3.0 (0.5) 0.6 (0.3) 0.1 (0.1) 0.3 (0.1) 
Latvia! O4 (0.3) 0.9 (0.2) 2.2 (0.6) 14 (04) 01 (02) 14 (02) 
Lithuania 0.4 (0.3) 0.1 (0.2) 24 (0.5) 14 (0.3) 01 (02) 0.4 (0.2) 
alta 03 (0.3) 0.5 (0.2) 18 (04) 2.0 (0.3) 0.4 (0.1) 0.3 (0.2) 
exico 0.5 (0.2) -0.1 (0.1) 12 (0.3) 0.8 (0.3) 0.0 (0.1) 0.4 (0.2) 
etherlandst -1.0 (0.3) 0.6 (0.2) 26 (04) 14 04) 0.3 (02) 10107) 
orway (9): 0.4 (0.2) 0.6 (0.1) 24 (0.3) 10 (02) 0.2 (0.1) 0.6 (0.1) 
Peru -0.1 (02) 01 (0.1) 0.9 (0.3) 0.9 (0.2) -0.2 (0.1) 0.4 (0.1) 
Russian Federation -0.2 (0.3) 0.4 (0.2) 0.8 (0.3) 1.3 (0.3) 0.3 (0.2) 0.8 (0.2) 
Slovenia -14 (0.3) 0.7 (0.2) 14 (0.5) 14 (04) 0.1 (0.2) 0.7 (0.2) 
Sweden! 03 (0.3) 0.4 (0.1) 2.6 (0.5) 24 (0.3) -0.2 (0.1) 0.8 (0.2) 
ICCS 2016 average 0.0 (0.1) 0.3 (0.0) 1.8 (0.1) TORO 0.1 (0.0) 0.5 (0.0) 
Countries not meeting sample participation requirements 
Hong Kong SAR -0.8 (0.3) 0.6 (0.2) 01 (0.4) A0 (0.4) 0.3 (0.2) 0.6 (0.2) 
Korea, Republic of? 0.6 (0.3) 0.2 (0.2) 18 (0.6) 1.5 (0.3) 0.3 (0.2) 0.7 (0.2) 
Notes: 
Statistically significant (p < 0.05) coefficients are displayed in bold. 
() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
! National Defined Population covers 90% to 95% of National Target Population. 
? Country surveyed target grade in the first half of the school year. 
An “(s)” indicates that data are available for at least 5096 but less than 7096 of students. 
2016 countries, with the range extending from 24 to 41 percent. The graph onthe right-hand side 
illustrates that, in most countries, almost half of the explained variance could be attributed to more 
than one group of predictors. Both student dispositions (self-efficacy and civic knowledge) and 
student beliefs (importance of conventional citizenship and trust in civic institutions) made larger 
unique contributions to the explanation of variance in the dependent variable. 
Theunstandardized regression coefficients for effects on students' expected electoral participation 
displayed in Table 7.7 showthat associations with student gender were inconsistent and significant 
inonly afew countries. We registered significant positive, but relatively weak, associations between 
students' expected electoral participation and students' socioeconomic status in 10 countries. 
Students' expectations of electoral participation were unrelated to socioeconomic status in the 
remaining countries. Parental interest in political and social issues and also students' interest in 
political and social issues were, however, consistent predictors across countries. On average, having 
at least one very interested or one quite interested parent was associated with a difference of 
almost two score points (equivalent to a fifth of an international standard deviation) in expected 
electoral participation, while students' interest in political and social issues had a net effect of more 
than one score point (equivalent to one tenth of an international standard deviation). 
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Weak, but significant, positive associations between expected electoral participation and students' 
current or past participation in community groups or organizations emerged in two countries. 
However, in 16 countries, past or current participation in civic activities at school was a significant 
positive predictor of expected electoral participation: overall, one (national) standard deviation 
was associated with an increase of O.5 of a scale score point on average. The results therefore 
show that students' experience of civic participation at school was only weakly associated with 
students' expectations of electoral participation in the future. 


Table 7.8 shows the unstandardized regression coefficients for variables related to students' 
civic dispositions and beliefs. Students' sense of citizenship self-efficacy was a consistent positive 
predictor of expected electoral participation across the participating countries. On average, 
ne (national) standard deviation was associated with an increase of over one scale score point 
(equivalenttoonetenth of an international standard deviation in the dependent variable). Students' 
civic knowledge was also a consistently strong, positive predictor of expected electoral participation 
across countries, with a net effect size of 2.4 scale score points, equivalent to almost a quarter of 
aninternational standard deviation. These findings are similar to those from ICCS 2009, and they 
emphasize the importance, as reflected inthe civic knowledge score, of dispositions for engagement 
such as self-efficacy and the student's ability to comprehend the political world. 


h 
h 


o 


Table 7.8: Multiple regression coefficients for expected electoral participation (dispositions and perceptions) 


Country Students' dispositions for civic engagement Students' perceptions 
Students' sense of Students civic Students' perceptions Students’ trust in civic 
citizenship self-efficacy knowledge ofthe importance of institutions 
conventional citizenship 
Belgium (Flemish) 0.9 (0.3) 28 (02) 17 (0.2) 11 (02) 
Bulgaria 13 (03 29 103) 21 903) 16 (02) 
Chile 1.6 (0.2) 3.0 (0.1) 2.6 (0.2) 2.0 (0.2) 
Chinese Taipei OF 102) 23 (0.1) 25 102) 0.6 (0.1) 
Colombia 13 (0.2) 25 (02) 18 (0.2) 13 (04) 
Croatia L0 (02 2.5 102) 19 (02) OF (02) 
Denmarkt 11 (0.2) 25 (01) 1.5 (0.1) 1.4 (0.1) 
Dominican Republic (s) 16 (02 De (02) 23. X02) 1.2 DM 
Estonia! 12 (02) 19 (02) 2.3 (0.2) 13 (02) 
Finland 4.4 (01) 2.3 (02) J:9 (Ox) ER 
taly 0. (0.2) 2.5 (02) 17 (0.1) 10 (0.1) 
Latvia! 1.2 (0:2) 2:2) (02) 2102) 14 (02) 
Lithuania 0.9 (0.2) 2.5 (02) 24 (02) 13 (02) 
alta 1.6 (0.2) 20 (02) 22 (02) 1:159 (0/2) 
exico 12 (02) 24 (02) 25 (02) 17 (02) 
etherlandst J2 (02) 33 102) L3 (02) 12 (02) 
orway (9)! 12 (01 2.9 (0.1) 08 (0.1) 15 (01) 
Peru 4.3 (0.1) 28 (02) 1:5: (Oa) 0.8 (02) 
Russian Federation 12 (03 37 402) 25 (02) 16 (0.2) 
Slovenia i 012 26 (02) 16 (02) 09 (0.2) 
Sweden: 14 (0.2) 2.0 (02) 0.9 (03) 13 (02) 
ICCS 2016 average 12 (0.0) 2.4 (0.0) 1.9 (00) 12 (0.0) 
Countries not meeting sample participation requirements 
Hong Kong SAR 1.6 (0.2) 24 (02) 1.6 (02) 11 (02) 
Korea, Republic of? 15 (02) 26 (02) 12 (0.2) OF (02) 


Notes: 

Statistically significant (p < 0.05) coefficients are displayed in bold. 

() Standard errors appear in parentheses. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 9096 to 9596 of National Target Population. 

? Country surveyed target grade in the first half of the school year. 

An "(s)" indicates that data are available for at least 50% but less than 7096 of students. 
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Table 7.9: Explained variance for active political participation 
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Croatia 6 (0.9) Pal ALI, M | 
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Table 7.10 shows the unstandardized regression coefficients for student background variables 
and factors reflecting experience with civic engagement. In most countries, we observed negative 
associations between gender (female) and expected active political participation. On average, the 
difference was associated with one scale score point. This finding suggests (after we had controlled 
for all other variables in the model) that the male students participating in ICCS were more inclined 
thanthe female students to think they would participate in explicitly political activities in the future. 


Several countries recorded weak but significant negative associations between students 
socioeconomic background and active political participation. The remaining countries recorded 
no significant effects. In 11 countries, parental interest in political and social issues was positively 
related to students' expected active political participation (with a net effect of about one score 
point), while students' interest in political and social issues was a positive predictor in 18 of the 
21 countries (with a net effect of more than one score point). 


Table 7.10: Multiple regression coefficients for expected active political participation (student background and civic 
participation) 


Country Student background variables Current and past participation 
Gender (female) Socioeconomic Parental Student Participation in Participation in 
background interest interest community civic activities 
organization at school 
and groups 
Belgium (Flemish) -1.0 (0.4) -0.1 (0.2) 1.3 (0.5) 1.7 (0.5) O.6 (0.2) 0.6 (0.2) 
Bulgaria -1.3 (0.4) -0.5 (0.3) 1.5 (0.5) 14 (0.4) 0.7 (0.3) 0:3 (03) 
Chile -0.7 (0.3) -0.5 (0.2) 1.4 (0.3) 1.0 (0.4) 0.6 (0.2) 0.8 (0.2) 
Chinese Taipei -1.5 (0.2) -0.2 (0.1) 0.0 (0.3) 1.4 (0.3) 0.4 (0.1) 0.5 (0.1) 
Colombia -0.7 (0.3) -0.5 (0.2) 0.6 (0.4) 0.9 (0.4) 0.6 (0.2) 0.3 (0.2) 
Croatia -1.7 (0.3) -0.1 (0.2) 1.6 (0.5) 1.6 (0.4) 0.2 (0.2) 0.5 (0.2) 
Denmark? -0.1 (0.2) -0.1 (0.1) 0.4 (0.3) 1.4 (0.2) 0.7 (0.1) 0.2 (0.1) 
Dominican Republic (s) -0.8 (0.4) -0.4 (0.2) 14 (0.3) 05 (Qu 0.8 (0.2) 05 (0.2) 
Estonia! -1.6 (0.3) -0.3 (0.2) O.6 (0.5) 0.4 (0.3) 0.7 (0.1) 0.5 (0.2) 
Finland -1.1 (0.3) Q. (09) 0.3 (0.4) 0.8 (0.3) O.6 (0.1) 0.2 (0.2) 
taly -1.3 (0.3) O.1 (0.1) 1:5. (0:5) 0.8 (0.4) 0.6 (0.1) 0.5 (0.2) 
Latvia! -1.6 (0.4) -0.1 (0.2) IROS) 15 (0.4) 0.4 (0.2) 0.9 (0.2) 
Lithuania -1.3 (0.4) OO (0.2) 1.4 (0.6) 1.4 (0.3) 0.8 (0.2) 0.1 (0.2) 
alta -1.8 (0.3) 0.0 (0.2) 0.6 (0.4) 2.4 (0.3) 1.0 (0.2) OB (02) 
exico -0.3 (0.3) -0.5 (0.1) 0.2 (0.3) 0.5 (0.3) 0.6 (0.2) 0.4 (0.2) 
etherlandst -0.7 (0.3) 02702) 1.5 (0.4) 1.4 (0.5) 0.9 (0.2) 0.4 (0.2) 
orway (9): -0.2 (0.3) 0.2 (0.1) 1.9 (0.3) 1.4 (0.3) 1.0 (0.1) 0.4 (0.1) 
Peru -0.3 (0.3) -0.7 (0.1) 0.7 (0.4) 0.9 (0.3) 0.5 (0.2) 0.5 (0.2) 
Russian Federation -1.8 (0.3) -0.5 (0.1) 0.5 (0.5) 1.0 (0.3) 0.4 (0.2) 0.7 (0.3) 
Slovenia -1.4 (0.3) -0.1 (0.2) 0.6 (0.5) 1.4 (0.4) 0.7 (0.2) 0.5 (0.2) 
Sweden! -0.4 (0.3) -0.3 (0.2) 1.7 (0.4) 1.7 (0.4) 0.6 (0.2) 0.4 (0.2) 
ICCS 2016 average -1.0 (0.1) -0.2 (0.0) 1.0 (0.1) 120801) 0.6 (0.0) 0.4 (0.0) 
Countries not meeting sample participation requirements 
Hong Kong SAR -1.9 (0.4) -0.3 (0.2) -0.2 (0.5) 2.2 (0.4) 0.6 (0.2) 0.9 (0.2) 
Korea, Republic of? -0.8 (0.4) -0.5 (0.2) 1.6. (0.7) 1.8 (0.5) 12 (02) 0.5 (0.3) 


Notes: 

Statistically significant (p < 0.05) coefficients are displayed in bold. 

() Standard errors appear in parentheses. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
+ Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 90% to 95% of National Target Population. 

? Country surveyed target grade in the first half of the school year. 

An "(s)" indicates that data are available for at least 50% but less than 70% of students. 
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In all but one country (Croatia), students' experience with participation in community groups or 
organizations also had consistent and significant positive associations with students' expectations 


of engaging actively as an adult. On average, one (national 
a very small increase in expected active political participa 


point. Students' civic engagement at school had significant 


political participation in 15 countries, with similarly smal 


less than half a score point per (national) standard deviation. 
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political participation by variables 
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tently strong and positive predictor of 
expected active political participation in all countries: here, a difference of one (national) standard 
deviation equated to an increase of more than two score points (ranging from 1.6 to 3.5), equivalent 
to about a fifth of an international standard deviation in the dependent variable. In keeping with 
our bivariate analyses presented in Chapter 4, students’ civic knowledge had significant negative 
associations in all but two countries with expected active political participation, a finding that 
was apparent after we controlled for other variables. On average across countries, one (national 
standard deviation made for a decrease of more than one scale score point (equivalent to a tenth 


Table 7.11: Multiple regression coefficients for expected active political participation (dispositions and perceptions) 


Country Students’ dispositions for civic engagement Students’ perceptions 
Students’ sense of Students’ civic Students’ perceptions Students’ trust in civic 
citizenship self-efficacy knowledge of the importance of institutions 
conventional citizenship 
Belgium (Flemish) 19 (0.2) -1.2 (0.2) 14 (0.2) 0.2 (0.3) 
Bulgaria 27 103) -2.7 (0.3) 17 (0.3) 12 (03) 
Chile 28 (02) -1.8 (0.2) 22 (0.3) 24 (0.2) 
Chinese Taipei 22 102) -1.0 (0.2) 14 (02) 10 (02 
Colombia 24 (02) -1.7 (0.2) 16 (0.2) 2.0 (0.2) 
Croatia 20 (02) -1.1 (0.2) 20 (02) 0.9 (02) 
Denmark? 1.6 (0.2) -0.3 (0.1) 12 (0.1) 0.5 (0.1) 
Dominican Republic (s) 22 102) -1.1 (02) 22 102) 18 (02) 
Estonia! 20 (02) -1.0 (0.2) 19 (02) 0.8 (02) 
Finland 21 (02) -0.4 (0.2) 15 (0.2) 0:2 (02) 
taly 2.0 (0.2) -0.6 (0.2) 1.6 (0.2) 12 (02) 
Latvia! 2:6 EE (DEZ) -1.5 (02) 12 (02) 1:1 (02) 
Lithuania 22 (02) -1.9 (0.2) 1.4 (0.2) 12 (02) 
alta 3:3: (02) -1.9 (0.2) 2.0 (0.2) 0.7 (02) 
exico 2.5 (02) -1.8 (0.2) 25 (0.2) 2.1 (0.2) 
etherlandst 24 (0.2) 01 (0.2) 14 (02 07 (G2) 
orway (9)! 24 (0.2) -1.0 (0.2) 14 (0.1) 0.4 (0.1) 
Peru 2.2 (02) -1.9 (02) 1.6 (0.2) 1.6 (0.2) 
Russian Federation 3.5 (04) -0.6 (0.2) 18 (0.2) 10 (0.2) 
Slovenia 17 (0.2) -0.9 (0.2) 14 (0.2) 10 (02) 
Sweden! 22 (02) -0.4 (0.2) 13 (03) 0.6 (0.2) 
ICCS 2016 average 2:9 (910) -1.2 (0.0) 17 (0.0) 1.1 (0.0) 
Countries not meeting sample participation requirements 
Hong Kong SAR 3.0 (0.3) -0.8 (0.3) 12 (0.3) 0.9 (0.3) 
Korea, Republic of? C7 wa) =2.2 (03) 22 103) 14 (03) 


Notes: 

Statistically significant (p < 0.05) coefficients are displayed in bold. 

() Standard errors appear in parentheses. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 9096 to 9596 of National Target Population. 

? Country surveyed target grade in the first half of the school year. 

An "(s)" indicates that data are available for at least 5096 but less than 70% of students. 
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These findings suggest that students who expect to be actively involved in political activities in the 
future are the students most likely to have the higher scores on the citizenship self-efficacy scale, 
while the students with the higher scores on the civic knowledge scale are the students less inclined 
to think they will actively engage in politics in the future. These results, which are similar to those 
reported from ICCS 2009, have implications for what higher levels of learning may lead to with 
regard to civic engagement because they indicate that students who achieve higher scores on the 
civic knowledge scale will hold more critical views of the functioning of conventional channels of 
political participation. These findings definitely warrant further investigation in the future. 


Students’ beliefs in the importance of adult participation in conventional citizenship such as voting 
and being informed was another consistently significant, positive predictor of expected active 
political participation in all countries; on average, the net effect was estimated as 1.7 score points. 
Students' trust in civic institutions was also positively associated with expected active political 
p 
o 
o 


E 


articipation in all but two countries—Belgium (Flemish) and Finland—with an average net effect 
f one scale score point. These findings, which are highly similar to those from the previous cycle 
FICCS in 2009, suggest that beliefs in the importance of citizen involvement through established 
channels as well as trust in the functioning of civic institutions have a bearing on whether young 
people expect to become actively engaged in politics in the future. 
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CHAPTER 8: 
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Main findings and implications for policy 


and practice 


After the collapse of communist regimes in Eastern Europe a 
of authoritarian regimes with democratic systems both there and in a number of countries in 
other regions of the world since the mid-1970s, Huntington (1991) postulated a “third wave” of 
democratization. The end of the 20th century consequently saw widespread expectation that 


free elections, recognition of human rights, freedom of s 


commonplace around the world. However, during the past de 
what Diamond (2014) has termed a worldwide “democratic re 


because of a surge in authoritarian government practi 
region, as well as the failure of popular movements to re 


nd the subsequent replacement 
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Countries also differed with regard to the student background variables included in ICCS 2016. 
In all except two countries, female students demonstrated higher civic knowledge than male 
students. Students with higher levels of socioeconomic background (measured by student reports 
on parental occupation, level of parental education, and the number of books in the home) also 
had higher levels of civic knowledge. We furthermore found that in most countries students from 
immigrant backgrounds and those who spoke a language other than the ICCS 2016 test language 
at home had lower levels of civic knowledge. It should be noted, however, that these results were 
computed without controlling for the influence of socioeconomic background. 


Aspects of students' civic engagement 


(CCS 2016 looked at the extent of students’ engagement in different spheres of society and 
sought to identify the factors within or across countries related to that engagement. Limitations 
on the extent to which lower-secondary students can actively participate in civic activities meant 
that, apart from reviewing students’ age-appropriate civic activities at and outside of school, ICCS 
2016 placed a particular focus on the following: students' beliefs about their capacity to engage, 
the value they place upon participation in civic-related activities at school, and their expectations 
of future civic engagement. ICCS 2016 also examined factors associated with civic engagement, 
and measured changes in some aspects of student engagement since 2009. 


For students, television news and discussions with parents remained important sources of 
information about political and social issues. We recorded a general decline since 2009 in the use of 
newspapers as a source of information about political and social issues in nearly every country that 
participated in both surveys. The frequency with which students were using television as a source 
of national and international news also appeared to have declined in about half of these countries. 
However, students talking with their parents about what was happening in other countries became 
m 
n 


ore frequent between 2009 and 2016 in most countries, a finding which suggests an increase 
in students' attention to global developments. Use of new social media for civic engagement was 
till limited, but it too varied considerably across the participating countries. 


LO 


comparison with ICCS 2009, ICCS 2016 found somewhat higher levels of student engagement 
discussions about political and social issues. The same was evident for confidence in civic 
participation. Students with higher levels of interest in political and social issues were more likely to 
discuss these issues. Although students’ confidence in civic engagement was positively associated 
with their interest in civic issues, it was not related to their levels of civic knowledge. 


n 
in 


We also found few changes over the seven years between the two surveys in the extent of students’ 
participation at school and students’ endorsement of the value of participation at school. Students’ 
willingness to participate in future civic activities appeared to be higher among female than male 
students. Willingness to participate at school was also greater among students who were more 
interested in political and social issues, but positive associations between this construct and civic 
knowledge were not evident in about half of the countries. 


Between 2009 and 2016, students' reported participation in voluntary activities and in their 
expectations to engage in elections (once eligible to do so) increased in a number of countries. 
We found no association between students' expected participation in legal protest activities and 
civic knowledge, but did find that expected participation in illegal protest activities was higher 
among students with lower levels of civic knowledge. Expected active political participation, such 
as becoming a candidate for office, was higher among students who were interested in political 


and social issues but notably lower among students who had high levels of civic knowledge. 
These findings suggest that acquisition of civic knowledge influences young people's expectations 
of civic engagement in the future in different ways. The differences certainly warrant further 
investigation, in particular the negative association between civic knowledge and expectation of 
active conventional political participation. 
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Students' attitudes toward important issues in society 


We also analyzed ICCS 2016 data with regard to students' beliefs about important civic issues in 
their societies. We looked at factors associated with the variation in students' attitudes toward civic 
institutions and society, their beliefs regarding the importance of different principles underlying 
society, and their perceptions of their communities and societies. We also examined changes in 
students beliefs, attitudes, and values since 2009. 


(CCS 2016 found differences in what the students perceived as good or bad for democracy. In 
some countries, the lower-secondary students viewed situations such as political leaders giving 
government jobs to their family members as good for democracy. In most other countries, however, 
students viewed this practice as bad for democracy. Students across the participating countries 
consistently saw government interference in court decisions, free election of political leaders, 
the right to peaceful protest, and equal rights for all ethnic/racial groups in a country as good 
for democracy. Students also consistently regarded the right to criticize the government and 
the existence of small differences in income in their country as positive for democracies. These 
results indicate that differences in national contexts (e.g., related to particular political cultures 
and everyday experiences) may shape students' perceptions of how democracies function. 


(CCS also measured students’ perceptions of what constitutes good citizenship. When asked about 
behaviors indicating good citizenship, the ICCS 2016 students tended to attach somewhat more 
importance to conventional engagement than did the students who participated in ICCS 2009. Th 
(CCS 2016 results also showed high levels of endorsement of personally responsible citizenshi 
behavior, with majorities rating obedience to the law, ensuring the economic welfare of familie 
and respecting others' opinions as very important. Students who were interested in political an 
social issues were more likely to regard conventional social-movement-related or personal 
responsible citizenship behaviors as important. Students with higher levels of civic knowledge wer 
more inclined to regard behaviors related to social-movement activities and personally responsib 
citizenship as important for being a good adult citizen. We found no consistent associations between 
civic knowledge and endorsement of the importance of conventional citizenship behaviors. This 
finding might relate to other results from ICCS 2016 indicating that students with higher levels of 
civi 
a 


no m 


mt Ob e Q 


vic knowledge are less inclined to anticipate actual participation in conventional forms of political 
ction when they reach adulthood. 


Students strongly endorsed gender equality and equal rights for ethnic and racial groups in their 
countries. Endorsement of gender equality increased between 2009 and 2016 in a number of 
countries. However, the pattern of males giving substantially less support than females to gender 
equality that we observed in 2009 was still evident in 2016. In contrast, levels of endorsement of 
equal rights for all ethnic and racial groups in society increased in almost all countries over the 
period between the two surveys. We also found that female students, students who were more 
interested in social and political issues, and students with higher levels of civic knowledge were 
the students most likely to endorse gender equality and equal rights for all ethnic and racial groups. 


ajorities of students viewed pollution, terrorism, water and food shortages, infectious diseases, 
and poverty as major threats to the world's future. However, the extent to which students saw these 
issues as threats varied across countries, a finding that suggests the influence of local contexts on 
these perceptions. Variation was particularly marked for the perceptions of water shortages and 
crime. Students from countries where these issues were more likely to be part of their everyday 
experience were also more likely to regard them as substantial threats to the world's future. 


In many countries, the ICCS 2016 students expressed greater trust than ICCS 2009 students did in 
their government, parliament, and courts of justice. However, they expressed less trust than their 
2009 counterparts in the media and in people in general. In more established and economically 
stable democracies, the more knowledgeable 2016 students tended to have greater trust in civic 
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ed as relevant in the ICCS 2016 assessment framework 
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economic stability and stable institutions, however, students' level of trust in civic institutions 
and the rule of law may be sufficient for them to see little or no need for individual engagement. 


Implications for policy and practice 
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basic democratic structures within schools a 
active participation have the potential to promote students' civic knowledge and their disposit 
to engage in civic-related activities in the future. 


nd providing students with early opportunities for 
on 


tries in the world continue to express concern about low levels of voter participation 
e, and there have been claims that voter abstention among this segment of 
the population has been a decisive factor shaping voting results. The links that the ICCS 2016 
findings suggest between civic knowledge, school-based experiences with civic engagement, and 
expectations to vote and participate in other civic activities in adulthood indicate that promotion 
of civic and citizenship education, in both formal and informal ways, should be considered as an 
essential means of helping young people become more conscious of their political roles and the 


importance of being participating citizens. 
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Outlook 


CCS 2016, like its predecessor ICCS 2009, has provided a rich database that we expect will 
contribute to generating new research and findings with substantial potential for providing further 
insights into civic and citizenship education. This publication is but a first report of the main findings 
basedoninitial analyses because ICCS 2016 will provide an ongoing basis for numerous research 
studies in the form of secondary analysis after the public release of the study's database. 


ented ICCS as a fully developed cycle of comparative studies of civic and citizenshi 
CCS 2009 was the first in the cycle; ICCS 2016 has been the second. Over comin 
years, the ICCS 2016 data will contribute to a wide range of secondary research activities, 
occurred with the CIVED 1999 and the ICCS 2009 datasets. The international research team wi 
soon commence preparations for the next study in the ICCS cycle, with data collection schedule 
for 2022. The initiation of this study will again address new developments and challenges in thi 
learning area, such as implications from growing migration, the prevalence of new social medi 
in young people's engagement with civic issues, the increased importance of notions of global 
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RATES 


Table A.1: Coverage of ICCS 2016 target population 
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Country 


International Target Population 


Exclusions from Target Population 


Coverage School-level Within-sample Overall exclusions 
(96) exclusions exclusions (96) 
(96) (6) 
Belgium (Flemish) 00 4.8 0d 4.9 
Bulgaria 00 6 0.9 2:5 
Chile 00 A 24 35 
Chinese Taipei 00 6 1577 9 
Colombia 00 0.2 0.2 0.4 
Croatia 00 o5 4.6 52 
Denmark 00 T 2.7 44 
Dominican Republic 00 il 0.0 Aa 
Estonia 00 2.1. 1.6 6.7 
Finland 00 2 de) OQ 
Hong Kong SAR 00 4.7 0.0 4.7 
taly 00 0.8 9:9 4.8 
orea, Republic of 00 Ki 3.0 4.7 
Latvia 00 4.3 2:2 6.5 
Lithuania 00 9:9. 1.8 5.3 
alta 00 6 0.2 1.8 
exico 00 0.9 1.1 20 
etherlands 00 3.0 OO By. 
orway 00 Be 4.2 5.5 
Peru 00 3.0 0.0 Sch 
Russian Federation 00 ab 3.0 5.1 
Slovenia 00 B 0.8 Qu 
Sweden 00 22 43 6.4 
Benchmarking participant 
North Rhine-Westphalia 00 1.4 5.6 7.0 
(Germany) 


Note: 
Because results are rounded to t 


he nearest whole number, some totals may appear inconsistent. 


O International Association for the Evaluation of Educational Achievement (IEA) 2018 
W. Schulz et al., Becoming Citizens in a Changing World, 
https://doi.org/10.1007/978-3-319-73963-2 
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APPENDIX B: REGRESSION ANALYSIS FOR CIVIC KNOWLEDGE AND 
AGE 


Table B.1: Regression results for civic knowledge and student age 


Country Unstandardized regression Explained variance (in 96) 
coefficient 

Belgium (Flemish) -38 (4.2) 7 Gs 
Bulgaria -26 (5.6) 1 43505) 
Chile -30 (30) 5- ^ (1,1) 
Chinese Taipei -8 (3.9) Oo SEE 
Colombia -15 (1.7) 4 (08) 
Croatia -25 (5.0) d (@ ó) 
Denmark! -34 (4.6) 2 (0.6) 
Dominican Republic -21 (1.8) 9 (13) 
Estonia! -2 (46) O (0.1) 
Finland -24 (6.0) 1. (09:5) 
taly -30 (4.0) 3 (09) 
Latviat -24 (4.3) 2 (06) 
Lithuania -4 (42) D (1 

alta -10 (538) OF (OD) 

exico -11 (3.8) 1 (04) 

etherlandst -31 (6.5) S ED 

orway (9)! 16 (7.1) O (0.2) 
Peru -32 (22) 10 (14) 
Russian Federation -7 (54) O (02) 
Slovenia -9 (5.1) Ü (02) 
Sweden: -28 (6.3) 1 (04) 
ICCS 2016 average -19 (1.0) 2 102 
Countries not meeting sample participation requirements 
Hong Kong SAR -4 (5.3) O (02) 
Korea, Republic of? 13 (54 Qo oT 
Notes: 


() Standard errors appear in parentheses. 

(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 
T Met guidelines for sampling participation rates only after replacement schools were included. 
1 National Defined Population covers 9096 to 9596 of National Target Population. 

? Country surveyed target grade in the first half of the school year. 
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APPENDICE D: ITEM MAPS 
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Figure D.1: Example of questionnaire item map 


Scale scores (mean = 50, standard deviation = 10) 


Item 20 30 40 50 60 70 80 
tem ` "s 
D ` i. 
BEES 
Item #3 
L] Strongly disagree Disagree B Agree B Strongly agree 


Example of how to interpret the item-by-score map 


#1: | Arespondent with score 30 has more than a 50% probability of strongly disagreeing with all 
three items 

#2: | Arespondent with score 40 has more than a 50% probability of not strongly disagreeing with 
Items 1 and 2 but of strongly disagreeing with Item 3 

#3: | Arespondent with score 50 has more than a 50% probability of agreeing with Item 1 and of 
disagreeing with Items 2 and 3 

#4: | Arespondent with score 60 has more than a 50% probability of strongly agreeing with Item 1 and 
of at least agreeing with Items 2 and 3 

#5: | A respondent with score 70 has more than a 5096 probability of strongly agreeing with Items 1, 2, 


and 3 
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Figure 4.1: Item map for the scale reflecting students' engagement with social media 


Scores 
How often are you involved in each of the following 


activities? 20 30 40 50 60 70 80 


Using the internet to find information about political 
or social issues 


social issue on the internet or social media 


Sharing or commenting on another person's online 
post regarding a political or social issue 


Posting a comment or image regarding a political or BH 


Never or hardly ever Monthly B Weekly Bil Daily or almost daily 


Sum 


Using the internet to find information about political 
RR 42 28 ek? 
or socialissues 100 


Posting a comment or image regarding a political or S 
social issue on the internet or social media 80 12 100 


Sharing or commenting on another person's online 


; SC ae 100 
post regarding a political or social issue 77 14 
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Figure 4.2: Item map for the scale reflecting students discussion of political and social issues outside 
school 


Scores 


How often are you involved in each of the following 
activities? 20 30 40 50 60 70 80 


alking with your parent(s) about political or social HE 
issues 


alking with friends about political or social issues | 


alking with friends about what is happening in other 
countries 


alking with your parent(s) about what is happening |— EE 
in other countries 


[ | Never or hardly ever Monthly B Weekly Bil Daily or almost daily 


alking with your parent(s) about political or social 
issues 


alking with friends about political or social issues 60 25 00 


47 29 


alking with your parent(s) about what is happening in 


: 20 25 ig 00 
other countries 


alking with friends about what is happening in other 36 36 
countries 
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Figure 4.3: Item map for the scale reflecting students' sense of citizenship self-efficacy 


How well do you think you would do the following 
activities? 20 30 40 50 60 70 


co 
e 


Discuss a newspaper article about a conflict between 
countries 


Argue your point of view about a controversial 
political or social issue 


Stand as a candidate in a «school election» 


Organize a group of students in order to achieve 
changes at school 


Follow a television debate about a controversial issue 


Write a letter or email to a newspaper giving your 
view on a current issue 


Speak in front of your class about a social or political 
issue 


Not at all Not very well B Fairly well B Very well 

Sum 
Discuss a newspaper article about a conflict between m a 
countries 6 si ile 
Argue your point of view about a controversial political 5 27 22 00 
or social issue 
Stand as a candidate in a «school election» 10 22 21 00 
Organize a group of students in order to achieve 8 28 00 


changes at school 


Follow a television debate about a controversial issue 9 34 18 00 
Write a letter or email to a newspaper giving your view E 

: paperig BY 10 S2 20 00 
on a current issue 
Speak in front of your class about a social or political 12 30 öö 
issue 
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Figure 4.4: Item map for the scale reflecting students' perception of the value of participation at school 


How much do you agree or disagree with the following 
statements about student participation at school? 


Student participation in how schools are run can 
make schools better. 


Lots of positive changes can happen in schools when 
students work together. 


Organizing groups of students to express their 
opinions could help solve problems in schools. 


Students can have more influence on what happens in 
schools if they act together rather than alone. 


Voting in student elections can make a difference to 
what happens at schools. 


Student participation in how schools are run can make 
schools better. 


Lots of positive changes can happen in schools when 
students work together. 


Organizing groups of students to express their 
opinions could help solve problems in schools. 


Students can have more influence on what happens in 
schools if they act together rather than alone. 


Voting in student elections can make a difference to 
what happens at schools. 


20 


30 


40 


Scores 


50 60 70 80 


Strongly disagree 


Disagree M Agree HB Strongly agree 


Sum 
2 8 38 00 
4 15 30 00 
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Figure 4.5: Item map for the scale reflecting students' preparedness to participate in school activities 


If you were given the chance, how likely is it that you would 20 30 40 50 60 70 80 
participate in each activity? 


Vote in a school election of «class representatives» 
or «school parliament» 


Join a group of students campaigning for an issue you 
agree with 


Become a candidate for «class representative» or EM  — 1 L— 
«school parliament» 


Take part in discussions in a «student assembly» 


Participate in writing articles for a school newspaper 
or website 


Not at all likely ot very likely B Quitelikely Bg very likely 
Sum 
Vote ina school election of «class representatives» or 5 15 "m 00 
«school parliament» 
Join a group of students campaigning for an issue you 7 28 m 00 


agree with 


Become a candidate for «class representative» or 


: 17 36 219) 00 
«school parliament» 


Take part in discussions in a «student assembly» 12 34 


2l 
Participate in writing articles for a school newspaper 20 38 00 


or website 


APPENDICES 


2 


N 


3 


Figure 4.6: Item map for the scale reflecting students’ expectations to participate in legal activities 


Would you take part in any of the following activities to 
express your opinion in the future? 


Talk to others about your views on political or social 
issues 


Contact an <elected representative> 


Take part in a peaceful march or rally 


Collect signatures for a petition 


Contribute to an online discussion forum about social 
or political issues 


Organize an online group to take a stance on a 
controversial political or social issue 


Participate in an online campaign 


Talk to others about your views on political or social 
issues 


Contact an <elected representative> 


Take part in a peaceful march or rally 


Collect signatures for a petition 


Contribute to an online discussion forum about social 
or political issues 


Organize an online group to take a stance on a 
controversial political or social issue 


Participate in an online campaign 


20 30 40 


Scores 


50 60 70 80 


| would certainly not do this 
Bl | would probably do this 


I would probably not do this 


HB! would certainly do this 


4 46 10 00 
1 36 16 00 
2 on 16 00 
3 42 12 00 
4 40 i2 00 
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Figure 4.7: Item map for the scale reflecting students' expectations to participate in illegal protest 


! P SC Scores 
Would you take part in any of the following activities to 


express your opinion in the future? 20 30 40 50 60 70 80 


Spray-paint protest slogans on walls 


Stage a protest by blocking traffic HES 


Occupy public buildings as a sign of protest 


| would certainly not do this | would probably not do this 
Bl | would probably do this WB! would certainly do this 
Sum 
Spray-paint protest slogans on walls 43 34 100 


Occupy public buildings as a sign of protest 50 SS 100 


Stage a protest by blocking traffic 46 34 100 
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Figure 4.8: Item map for the scale reflecting students’ expected electoral participation 
Scores 


When you are an adult, what do you think you will do? 20 30 40 50 60 70 80 


Vote in «national elections» 


Get information about candidates before voting in an 
election 


| would certainly not do this | would probably not do this 
Bl | would probably do this WB | would certainly do this 
Sum 
Vote in «local elections» 4 10 49 100 
Vote in «national elections» 4 10 100 


Get information about candidates before voting in an 


50 
š 5 14 45 100 
election 
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Figure 4.9: Item map for the scale reflecting students' expected active political participation 


Scores 


When you are an adult, what do you think you will do? 20 30 40 50 60 70 80 


Help a candidate or party during an election 
campaign 


Join a political party 


Stand as a candidate in «local elections» 


Join an organization for a political or social cause 


| would certainly not do this | would probably not do this 
Bl | would probably do this WB | would certainly do this 


Help a candidate or party during an election campaign 13 44 Is 00 


Join a political party 27 47 


Stand as a candidate in «local elections» 31 44 


Join an organization for a political or social cause 21 45 
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EXPLAINING VARIATION IN STUDENTS’ CIVIC KNOWLEDGE AND EXPECTED CIVIC ENGAGEMENT 


Figure 5.1: Item map for the scale reflecting students' perception of the importance of conventional 


citizenship 


How important are the following behaviors for being a 
good adult citizen? 


Voting in every national election 


Joining a political party 


Learning about the country's history 


Following political issues in the newspaper, on the 


radio, on TV, or on the internet 


Showing respect for government representatives 


Engaging in political discussions 


Voting in every national election 


Joining a political party 


Learning about the country's history 


Following political issues in the newspaper, on the 
radio, on TV, or on the internet 


Showing respect for government representatives 


Engaging in political discussions 


20 30 


40 


Scores 


50 60 70 


2 


N 


7 


Not important at all 


Not very important 


WB Very important 


EN 
jm 


[e N w A - 
[o CO NS] O n 


Ill] Important 
3 16 
14 53 
4 ES 
4 20 
3 Ls) 
10 46 
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o 
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Figure 5.2: Item map for the scale reflecting students' perception of the importance of social-movement-related 


citizenship 


How important are the following behaviors for being a 
good adult citizen? 


Participating in peaceful protests against laws 
believed to be unjust 


Participating in activities to benefit people in the 
«local community» 


Taking part in activities promoting human rights 


Taking part in activities to protect the environment 


Participating in peaceful protests against laws believed 
to be unjust 


Participating in activities to benefit people in the «local 
community» 


ing part in activities promoting human rights 


ki 


ki 


ing part in activities to protect the environment 


20 30 


Scores 


Not important at all 


Not very important 


Bl importan Wi Very important 
Sum 
8 30 24 00 
3 dë 35 00 
2 12 45 00 
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Figure 5.3: Item map for the scale reflecting students’ perception of the importance of personal 


responsibility for citizenship 


How important are the following behaviors for being a 
good adult citizen? 


Working hard 


Always obeying the law 


Ensuring the economic welfare of their families 


Making personal efforts to protect natural resources 
(e.g. through saving water or recycling waste) 


Respecting the rights of others to have their own 
opinions 


Supporting people who are worse off than you 


Engaging in activities to help people in less developed 
countries 


Working hard 


Always obeying the law 


Ensuring the economic welfare of their families 


Making personal efforts to protect natural resources 
(e.g. through saving water or recycling waste) 


Respecting the rights of others to have their own 
opinions 


Supporting people who are worse off than you 


Engaging in activities to help people in less developed 
countries 


20 30 


Scores 


40 50 60 70 8 


CH 


Hot important at al 


Not very important 


Bl Important WB Very important 

Sum 
3 12 42 00 
2 A 59 00 
al 5 60 00 
2 E 49 00 
1 4 62 00 
2 7 49 00 
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Figure 5.4: Item map for the scale reflecting students' endorsement of gender equality 


How much do you agree or disagree with the following 
statements? 


Men and women should have equal opportunities to 
take part in government. 


Men and women should have the same rights in every 
way. 


Women should stay out of politics. 


When there are not many jobs available, men should 
have more right to a job than women. 


Men and women should get equal pay when they are 
doing the same jobs. 


Men are better qualified to be political leaders than 
women. 


Men and women should have equal opportunities to 
take part in government. 


Men and women should have the same rights in every 
way. 


Women should stay out of politics. 


When there are not many jobs available, men should 
have more right to a job than women. 


Men and women should get equal pay when they are 
doing the same jobs. 


Men are better qualified to be political leaders than 
women. 


20 30 


Scores 


40 50 60 70 80 


Strongly disagree Disagree Wi Agree Strongly agree 
Sum 
ab 2 AS 00 
45 90 


ENE ` — 
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Figure 5.5: Item map for the scale reflecting students' endorsement of equal rights for all ethnic/racial groups 


How much do you agree or disagree with the following 
statements? 


Al 
ch 


Al 
ch 


Sc 
of 


«Members of all ethnic/raci 


«ethnic/racial groups» s 
ance to get a good educa 


«ethnic/racial groups» s 


ools should teach stude 
all ethnic/racial groups». 


hould have an equal 
tion in «country of test». 


ould have an equal 


ance to get good jobs in «country of test». 


ts to respect «members 


al groups» should be 


encouraged to run in elections for political office. 


«Members of all ethnic/raci 


al groups» should have 


the same rights and responsibilities. 


All «ethnic/racial groups» should have an equal chance 
to get a good education in «country of test». 


All «ethnic/racial groups» should have an equal chance 
to get good jobs in «country of test». 


Schools should teach students to respect «members of 


all 


ethnic/racial groups». 


«Members of all ethnic/racial groups» should be 
encouraged to run in elections for political office. 


<Members of all ethnic/racial groups> should have the 
same rights and responsibilities. 


20 


30 


40 


Scores 


50 60 70 


2 


w 


1 


[ ] Strongly disagree 


E| Disagree 


Wi Agree HB Strongly agree 


20 


30 


wn 
CO 
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Figure 5.6: Item map for the scale reflecting students' trust in civic institutions 


How much do you trust each of the following groups, 
institutions, or sources of information? 


The «national government» of «country of test» 


The «local government» of your town or city 


Courts of justice 


The police 


Political parties 


« National parliament» 


The «national government» of «country of test» 


The «local government» of your town or city 


Courts of justice 


The police 


Political parties 


«National parliament 


Scores 

20 30 40 50 60 70 80 
_ H“ 
_ H. 
_ s 
— M 
JN 
JEN 

Not at all itle ` gl Quite alot B Completely 
Sum 
7 28 19 00 
5 E 16 00 
9 E 15 00 
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Figure 5.7: Item map for the scale reflecting students endorsement of religious influence in society 


How much do you agree or disagree with the following 
statements about religion? 20 


30 


40 


Scores 


50 60 70 


2 


w 


3 


co 
CH 


Religion is more important to me than what is 
happening in national politics. 


Religion helps me to decide what is right and what is 
wrong. 


Religious leaders should have more power in society. 


Religion should influence people's behavior towards 
others. 


Rules of life based on religion are more important 
han civil laws. 


Religious people are better citizens. 


Strongly disagree 


Disagree |N Agree Wi Strongly agree 


Religion is more important to me than what is 
appening in national politics. 


Religion helps me to decide what is right and what is 


wrong. 


Religious leaders should have more power in society. 


Religion should influence people's behavior towards 
others. 


Rules of life based on religion are more important than 
civil laws. 


Religious people are better citizens. 


20 36 17 
20 30 18 
25 41 10 


o 
o 


o 
o 


o 
o 


o 
o 
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Figure 6.1: Item map for the scale reflecting students' perception of openness in classroom discussions 


When discussing political or social issues during regular 


lessons, how often do the followin 


Teachers encourage students 
minds. 


Teachers encourage students 
pinions. 


tudents bring up current poli 
scussion in class. 


tudents express opinions in c 


their opinions are different fro 


tudents. 


g things happen? 


o make up their own 


o express their 


ical events for 


ass even when 
m most of the other 


Teachers encourage students 


Teachers present several sides 
explaining them in class. 


Teachers encourage students 
minds. 


Teachers encourage students 
opinions. 


Students bring up current poli 
discussion in class. 


Students express opinions in c 


opinions are different from most of the other students. 


Teachers encourage students 


O discuss the issues 


with people having different opinions. 


of the issues when 


o make up their own 


o express their 


ical events for 


ass even when their 


O discuss the issues 


with people having different opinions. 


Teachers present several sides of the issues when 


explaining them in class. 
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Scores 

20 30 40 50 60 70 80 
| jw 
O o 
7/7 
046 
WEN 
` "w 

Never Rarely [WE Sometimes | Often 
Sum 
9 16 34 00 
5 IER 39) 00 
7 19 33 00 
15 26 22 00 
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Figure 6.2: Item map for the scale reflecting students’ perception of student-teacher relations at school 


How much do you agree or disagree with the following 
statements about teachers and students at your school? 


ost of my teachers treat me fairly. 


ea) 


udents get along well with most teachers. 


ost of my teachers listen to what | have to say. 


f | need extra help, | receive it from my teachers. 


Most of my teachers treat me fairly. 


Students get along well with most teachers. 


Most teachers are interested in students’ well-being. 


Most of my teachers listen to what | have to say. 


If | need extra help, | receive it from my teachers. 


ost teachers are interested in students’ well-being. 


235 
Scores 
20 30 40 50 60 70 80 
[]Stronglydisagree [Disagree [Agree [Mf Strongly agree 

Sum 

3 10 m 00 

3 23 21 00 

3 14 33 00 

2 10 37 00 
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Figure 6.3: Item map for the scale reflecting students' reports on physical or verbal abuse 


Scores 


During the last three months, how often did you 20 30 40 50 60 70 80 
experience the following situations at your school? 


A student called you by an offensive nickname. 


A student threatened to hurt you. 


You were physically attacked by another student. 


A student broke something belonging to you on 
purpose. 


A student posted offensive pictures or text about you 
on the internet. 


A student said things about you to make others laugh. HE 


Not at all Once M 2to4times Į 5timesor more 

Sum 
A student called you by an offensive nickname. 45 26 14 00 
A student said things about you to make others laugh. 44 Dy 00 
Astudent threatened to hurt you. 81 11 3 00 
You were physically attacked by another student. 84 11 2 09 
A student broke something belonging to you on 80 15 = 00 
purpose. 2 
A student posted offensive pictures or text about you 90 7 00 
onthe internet. 
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Figure 6.4: Item map for the scale reflecting students’ reports on learning of civic issues at school 

Scores 
At school, to what extent have you learned about the 20 30 40 50 60 70 80 


following topics? 


ow Citizens can vote in local or national elections 


ow laws are introduced and changed in «country 
oftest» 


Ow to protect the environment (e.g. through 
energy-saving or recycling) 


ow to contribute to solving problems in the «local 
community» 


ow citizen rights are protected in «country of test» 


Political issues and events in other countries 


How the economy works 


Not at all o a small extent 


Il] To a moderate extent 


To alarge extent 


OW Citizens can vote in local or national elections 11 26 00 
ow laws are introduced and changed in <country of 12 30 20 00 
est» 

ow to protect the environment (e.g. through energy- 4 15 47 00 
saving or recycling) 

ow to contribute to solving problems in the <local 2 33 19 00 
community> 

ow citizen rights are protected in <country of test> 2 27 26 00 
Political issues and events in other countries 3 34 16 00 
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APPENDIX E: PAIR-WISE COMPARISONS OF CIVIC KNOWLEDGE 


Table E.1: Pair-wise comparisons of average country civic knowledge scale scores 
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S E 
fig E 
E «| à E g 
Country Average E E $ E = 3 E E 9 5 = £ 2 E 2 8 n 5 E J t 
scale score aje is Esse os si s jail a o x|$|à8 
Denmark! 586 (3.0) A À À À À À A A A4 AA À À À À À À À 
Chinese Taipei 561 (30) A À A À À Al A A AA À À À À À À À 
Sweden! 579 (2.8) A À À À À A ÀA À AJAJ À À À À À À À 
Finland 577 (Sy v A À À À À A A A AA À A À À A À À 
Norway (9): 564 (2.2) Y Y Y v A À À À A À À AA À À À À À À À 
Estonia! 546 (3.1) www wv A A A A AA À À À À À À À 
Russian Federation 545 (4.3) Y VY Y Y YV A Al A A AA À A À À À À À 
Belgium (Flemish) Sar (4.1) Y Y Y Y YV A À AA À À À À À À À 
Slovenia 532 (2.5) Y Y Y YY Y YV À A À À À À À À À À 
Croatia Soil WZS) Y Y Y Y Y Y YV A À À À À À À À À 
taly 524 (24) Y Y Y YY Y vv v A À À À À À À À 
etherlands! 529 (45) Y Y Y Y vv Y YV A À À À À À À À 
Lithuania 518 (3.0) Y Y Y Y Y Y ww v YV A À À À À À À À 
Latvia! 492 (3.1) Y YV YV Y Y Y ww ww www A À À À A 
alta 491 (2.7) Y Y YV Y Y Y vvv vvv v A À À À A 
Bulgaria 485 (5.3) Y YV YV Y VV ww Y Y www À À À 
Chile 482 (3.1) Y YV V Y Y Y Y Y Y YY YY vv YV À À À 
Colombia 482 (3.4) V A IMA KAES NV ASA AZ AZT AAA EV) LV EN, À À À 
exico 467 (2.5) Y V YV V Y Y V Y YV A YY YY YY YY Y YV À À 
Peru 438 (3.5) NM I V ISA AMAA VI 9 V Y AZT VI VY I VY YO YV YV YV AZ Y A 
Dominican Republic 381 (3.0) VY V YV V V YL VV V AN A YL www V V V ww 


À Achievement significantly higher than in comparison country 


W Achievement significantly lower than in comparison country 


Notes: 


() Standard errors appear in parentheses. 
(9) Country deviated from International Defined Population and surveyed adjacent upper grade. 


T Met guidelines for sampling participation rates only after replacement schools were included. 
! National Defined Population covers 9096 to 9596 of National Target Population. 
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APPENDIX F: ORGANIZATIONS AND INDIVIDUALS INVOLVED IN 
ICCS 2016 
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LPS (Laboratorio di Pedagogia Sperimentale at the Roma Tre University, Rome, Italy) on behalf 
of the IEA. 
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Dulce Lay, data analyst 
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Staff at LPS 

Bruno Losito, associate research director 
Gabriella Agrusti, project researcher 
Elisa Caponera, project researcher 

Paola Mirti, project researcher 

Valeria Damiani, project researcher 
Francesco Agrusti, project researcher 
Alessandro Sanzo, project researcher 


International Association for the Evaluation of Educational Achievement (IEA) 

IEA provides overall support and supervision for ICCS. The IEA Hamburg, Germany, as the 
international coordinating center for ICCS, is responsible for overall coordination of all activities, 
relations with participating countries, and sampling and data-processing. The IEA Amsterdam, the 
Netherlands, is responsible for translation verification and quality monitoring of the data collection. 


Staff at the IEA Hamburg 

Ralph Carstens, project director 

arta Kostek, project coordinator 

Juliane Kobelt, project coordinator 

Falk Brese, international data manager 
Hannah Kóhler, international data manager 
Christine Busch, deputy international data manager 
Sabine Weber, researcher (sampling) 
Sabine Tieck, researcher (sampling) 

Diego Cortes, researcher (sampling) 

Olaf Zuehlke, researcher (sampling) 

Duygu Savasci, research analyst (sampling) 
Dirk Oehler, research analyst 
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Tim Daniel, research analyst 
Michael Jung, research analyst 
Alena Becker, research analyst 
Parisa Aghakasiri, research analyst 
Kamil Kowolik, research analyst 
Svetoslav Velkov, research analyst 
Ekaterina Mikheeva, research analyst 
Clara Beyer, research analyst 
Oriana Mora, research analyst 

aike Junod, programmer 
Limiao Duan, programmer 
Deepti Kalamadi, programmer 
Bettina Wietzorek, meeting and seminar coordinator 
Heiko Sibberns, director 


Staff at the IEA Amsterdam 


Dirk Hastedt, executive director 

Paulina Koršňáková, director of the IEA Secretariat 
Andrea Netten, director of the IEA Secretariat 
Gabriela Noveanu, senior researcher 

Gillian Wilson, publications officer 

Roel Burgers, financial manager 

Isabelle Gemin, financial officer 

Anna Kahne, public outreach officer 


Project advisory committee (PAC) 
The ICCS 2016 PAC has, from the beginning of the project, advised the international study 
center and its partner institutions during regular meetings. 


PAC members 

Erik Amná, Órebro University, Sweden 

Cristián Cox, Diego Portales University, Chile 

Barbara Malak-Minkiewicz, Netherlands 

Judith Torney-Purta, University of Maryland, United States 

Wiel Veugelers, University of Humanistic Studies Utrecht, Netherlands 


Other project advisors 


ICCS sampling referee 
Marc Joncas from Statistics Canada in Ottawa was the sampling referee for the study. He provided 
invaluable advice on all sampling-related aspects of it. 


Expert 

Christian Monseur (Université de Liége) conducted a review of test and questionnaire scaling 
methodology. In addition, the international study center invited him to review the content of the 
international report. 
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ICCS 2016 National Research Coordinators (NRCs) 

The national research coordinators (NRCs) played a crucial role in the development of 

the project. They provided policy- and content-oriented advice on the development of the 
instruments and were responsible for the implementation of ICCS in participating countries. 
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Ellen Claes 
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Bulgaria 

Svetla Petrova 

Center for Control and Assessment of the Quality in School Education 
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Ines Elezovic 
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Danish School of Education, Aarhus University 
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Massiel Cohen 

Ancell Scheker 

Ministry of Education 
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Tallin University 

Finland 

Jouko Mehtáàlàinen 

Finnish Institute for Educational Research, University of Jyväskylä 
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Hermann Josef Abs 

University of Duisburg-Essen 

Hong Kong SAR 

Wai Man Lam 

Centre for Civil Society and Governance, the University of Hong Kong 


Italy 
Laura Palmerio 
INVALSI 
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Ireta Chekse 
University of Latvia 
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National Examination Center 
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